2024-09-21T07:13:58.164 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T07:13:58.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:13:58.285 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913594' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnFIbGLDaA0Acomd2SbFOm/WSnn/YEng52r9Un9epGXIdmrw2+6DM4puc6nug25B+Gecy/VMEkK1IHb2qEgZNE= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKgHQQ16haZnt4ta2gCEpiVyePj2mbsBpaVKN5M4TksLR78dSRzN+c8bg02m1kWIGgyje+ib8msyQktH1555+g= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHvuCB0mqy09+m3PdQOwRoKAGxDbKLnoQUoG4OwAsafaTxuegLSfjcPRrvN3u93LyF657N+CM1HqPf/Bt4CwGU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T07:13:58.285 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T07:13:58.286 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T07:13:58.286 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T07:13:58.288 INFO:teuthology.task.internal:Checking packages... 2024-09-21T07:13:58.308 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T07:13:58.308 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T07:13:58.308 INFO:teuthology.packaging:ref: None 2024-09-21T07:13:58.308 INFO:teuthology.packaging:tag: None 2024-09-21T07:13:58.308 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:13:58.308 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:13:58.309 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:13:58.463 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T07:13:58.465 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T07:13:58.472 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T07:13:58.472 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T07:13:58.484 INFO:teuthology.task.internal:Saving configuration 2024-09-21T07:13:58.505 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T07:13:58.516 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T07:13:58.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:08:58.293218', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnFIbGLDaA0Acomd2SbFOm/WSnn/YEng52r9Un9epGXIdmrw2+6DM4puc6nug25B+Gecy/VMEkK1IHb2qEgZNE='} 2024-09-21T07:13:58.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:08:58.295149', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKgHQQ16haZnt4ta2gCEpiVyePj2mbsBpaVKN5M4TksLR78dSRzN+c8bg02m1kWIGgyje+ib8msyQktH1555+g='} 2024-09-21T07:13:58.588 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 07:08:58.296646', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHvuCB0mqy09+m3PdQOwRoKAGxDbKLnoQUoG4OwAsafaTxuegLSfjcPRrvN3u93LyF657N+CM1HqPf/Bt4CwGU='} 2024-09-21T07:13:58.588 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T07:13:58.598 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T07:13:58.598 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T07:13:58.598 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T07:13:58.598 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T07:13:58.685 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f645620b520>, signals=[15]) 2024-09-21T07:13:58.685 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T07:13:58.694 INFO:teuthology.task.internal:Opening connections... 2024-09-21T07:13:58.694 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T07:13:58.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:13:58.771 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-09-21T07:13:58.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:13:58.844 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-09-21T07:13:58.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:13:58.919 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T07:13:58.928 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-21T07:13:58.946 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-21T07:13:58.947 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:13:59.005 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:13:59.006 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:13:59.006 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:13:59.006 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:13:59.006 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-21T07:13:59.029 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-09-21T07:13:59.047 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-09-21T07:13:59.047 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-09-21T07:13:59.104 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-09-21T07:13:59.104 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-09-21T07:13:59.104 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-09-21T07:13:59.104 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:13:59.105 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:13:59.105 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-09-21T07:13:59.129 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-09-21T07:13:59.147 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-09-21T07:13:59.147 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-09-21T07:13:59.205 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-09-21T07:13:59.205 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-09-21T07:13:59.206 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T07:13:59.207 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T07:13:59.207 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T07:13:59.207 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-09-21T07:13:59.228 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T07:13:59.240 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T07:13:59.247 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T07:13:59.249 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:13:59.252 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:13:59.254 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-09-21T07:13:59.271 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T07:13:59.278 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T07:13:59.278 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:13:59.309 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:13:59.311 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-09-21T07:13:59.403 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T07:13:59.479 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T07:13:59.494 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T07:13:59.495 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T07:13:59.495 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T07:13:59.495 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:13:59.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:13:59.512 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-21T07:13:59.570 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-21T07:13:59.570 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-21T07:13:59.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-21T07:14:01.929 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T07:14:07.247 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-21T07:14:13.014 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-21T07:14:14.539 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-21T07:14:15.369 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-21T07:14:20.958 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T07:14:22.965 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T07:14:22.965 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T07:14:23.068 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T07:14:23.073 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T07:14:23.073 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-21T07:14:23.073 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-21T07:14:23.074 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:14:23.075 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-21T07:14:23.075 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-21T07:14:23.075 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T07:14:23.210 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 315 kB/s | 36 kB 00:00 2024-09-21T07:14:26.551 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-09-21T07:14:28.310 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.6 MB/s | 29 MB 00:05 2024-09-21T07:14:29.068 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.8 MB/s | 35 MB 00:05 2024-09-21T07:14:29.069 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:14:29.069 INFO:teuthology.orchestra.run.smithi060.stdout:Total 13 MB/s | 79 MB 00:05 2024-09-21T07:14:29.783 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T07:14:30.132 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T07:14:30.132 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T07:14:31.135 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T07:14:31.135 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T07:14:33.692 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T07:14:34.381 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:14:34.480 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:14:37.224 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:14:37.357 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:14:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:14:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:14:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:15:26.751 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:15:26.791 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:15:27.174 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:15:27.174 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T07:15:27.174 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T07:15:27.175 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T07:15:28.027 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:15:28.028 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T07:15:28.389 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:15:28.484 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:15:28.485 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:15:28.485 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T07:15:28.485 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T07:15:28.485 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T07:15:28.485 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T07:15:28.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T07:15:28.486 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T07:15:28.544 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T07:15:28.544 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T07:15:28.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-21T07:15:28.577 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-21T07:15:28.578 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:15:28.579 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T07:15:28.579 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T07:15:28.579 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-508.el9.x86_64 2024-09-21T07:15:28.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T07:15:29.218 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-21T07:15:30.506 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T07:15:30.535 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-21T07:15:30.537 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-21T07:15:30.551 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.KYctNQcx1d 2024-09-21T07:15:30.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KYctNQcx1d 2024-09-21T07:15:30.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.KYctNQcx1d 2024-09-21T07:15:30.759 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.KYctNQcx1d is 6KB 2024-09-21T07:15:30.778 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.KYctNQcx1d 2024-09-21T07:15:30.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T07:15:30.854 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T07:15:30.854 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T07:15:30.855 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T07:15:30.855 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T07:15:30.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T07:15:31.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-21T07:16:01.005 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T07:16:01.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T07:16:01.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:16:19.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-09-21T07:16:28.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T07:16:28.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:17:28.571 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T07:17:40.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T07:17:40.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:17:40.910 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-21T07:17:41.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T07:17:41.306 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T07:17:41.306 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-21T07:17:41.323 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-508.el9.x86_64 2024-09-21T07:17:41.323 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T07:17:41.323 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T07:17:41.324 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T07:17:42.324 DEBUG:teuthology.parallel:result is None 2024-09-21T07:17:42.324 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T07:17:42.331 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T07:17:42.331 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:17:42.334 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:17:42.336 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T07:17:42.355 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T07:17:42.361 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T07:17:42.370 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T07:17:42.370 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:17:42.393 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:17:42.395 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T07:17:42.553 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T07:17:42.559 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T07:17:42.559 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:17:42.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:17:42.577 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T07:17:42.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:17:42.594 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:17:42.597 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:17:42.619 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T07:17:42.651 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:17:42.674 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:17:42.694 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:17:42.697 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:17:42.714 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:17:42.718 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T07:17:42.720 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T07:17:42.726 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T07:17:42.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:17:42.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:17:42.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T07:17:42.758 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T07:17:42.766 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T07:17:42.766 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:17:42.799 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:17:42.801 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T07:17:42.818 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:17:42.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:17:42.948 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:17:43.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:17:43.077 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:17:43.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:17:43.145 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:17:43.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:17:43.242 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:17:43.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:17:43.368 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:17:43.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:17:43.435 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:17:43.480 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T07:17:43.543 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:17:43.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T07:17:43.631 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:17:43.631 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T07:17:43.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-21T07:17:43.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-09-21T07:17:43.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-09-21T07:17:43.740 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:17:43.751 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:17:43.779 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:17:44.157 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T07:17:44.165 INFO:teuthology.task.internal:Starting timer... 2024-09-21T07:17:44.165 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T07:17:44.175 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T07:17:44.183 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T07:17:44.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-21T07:17:44.257 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-21T07:17:44.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-09-21T07:17:44.318 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-09-21T07:17:44.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2024-09-21T07:17:44.369 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2024-09-21T07:17:44.371 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T07:17:44.371 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-21T07:17:44.400 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-21T07:17:44.400 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-09-21T07:17:44.422 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-09-21T07:17:44.422 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2024-09-21T07:17:44.444 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2024-09-21T07:17:44.444 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2024-09-21T07:17:44.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:17:44.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:17:44.475 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:17:44.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:17:44.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:17:44.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:17:44.536 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T07:17:44.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:17:44.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:17:44.625 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2024-09-21T07:17:44.657 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T07:17:44.684 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T07:17:44.687 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T07:17:44.814 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T07:17:44.825 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T07:17:44.826 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi123.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T07:21:45.281 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-09-21T07:21:45.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T07:21:45.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:21:45.362 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-21T07:21:45.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T07:21:45.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-21T07:21:45.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:21:45.517 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-21T07:21:45.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-21T07:21:45.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T07:21:45.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T07:21:45.680 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-21T07:21:45.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-21T07:21:45.763 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T07:21:45.779 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T07:21:45.779 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:21:45.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:21:45.781 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:21:45.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:21:45.784 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T07:21:45.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:21:45.811 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:21:45.812 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:21:45.826 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:21:45.826 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:21:45.833 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T07:21:45.849 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T07:21:45.850 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-09-21T07:21:45.852 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-21T07:21:45.862 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-09-21T07:21:45.864 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-21T07:21:45.874 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2024-09-21T07:21:45.875 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:21:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:21:45.886 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2024-09-21T07:21:45.889 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:21:45.893 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:21:45.900 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T07:21:45.915 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T07:21:45.954 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:21:45.954 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:21:45.957 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:21:45.957 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-21T07:21:45.957 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.957 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.957 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.957 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.959 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:21:45.959 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-21T07:21:45.959 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.959 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.959 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.959 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.970 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:21:45.973 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:21:45.973 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-09-21T07:21:45.973 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:45.973 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:46.044 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:46.044 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:21:46.045 INFO:teuthology.run_tasks:Running task install... 2024-09-21T07:21:46.055 DEBUG:teuthology.task.install:project ceph 2024-09-21T07:21:46.055 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T07:21:46.055 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T07:21:46.056 INFO:teuthology.task.install:Using flavor: default 2024-09-21T07:21:46.061 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T07:21:46.061 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T07:21:46.061 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:21:46.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:21:46.063 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:21:46.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:21:46.064 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T07:21:46.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:21:46.218 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:21:46.218 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:21:46.221 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:21:46.221 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:21:46.224 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T07:21:46.224 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T07:21:46.326 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:21:46.326 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:21:46.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:21:46.332 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:21:46.332 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:21:46.332 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:21:46.338 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T07:21:46.338 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:21:46.338 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T07:21:46.352 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:21:46.353 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:21:46.358 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:21:46.358 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:21:46.364 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T07:21:46.364 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T07:21:46.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:21:46.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:21:46.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T07:21:46.494 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:21:46.499 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:21:46.505 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T07:21:46.559 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-21T07:21:46.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-21T07:21:46.563 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-09-21T07:21:46.565 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-09-21T07:21:46.568 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2024-09-21T07:21:46.569 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2024-09-21T07:21:46.786 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-09-21T07:21:46.793 INFO:teuthology.orchestra.run.smithi187.stdout:45 files removed 2024-09-21T07:21:46.799 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-21T07:21:46.813 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:21:46.820 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:21:46.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T07:21:47.360 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-21T07:21:47.375 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 291 kB/s | 84 kB 00:00 2024-09-21T07:21:47.383 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 327 kB/s | 84 kB 00:00 2024-09-21T07:21:47.653 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T07:21:47.667 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T07:21:47.675 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T07:21:47.943 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T07:21:47.945 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-21T07:21:47.959 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T07:21:48.462 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T07:21:49.301 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.3 MB 00:01 2024-09-21T07:21:49.368 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.3 MB 00:01 2024-09-21T07:21:50.446 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T07:21:51.036 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-21T07:21:51.277 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T07:21:55.412 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T07:21:55.747 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-21T07:21:55.787 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T07:21:56.937 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-21T07:21:57.181 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-21T07:21:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 19 kB 00:00 2024-09-21T07:21:57.666 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-21T07:21:58.144 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T07:21:58.200 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T07:22:03.039 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T07:22:03.650 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T07:22:03.848 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T07:22:05.160 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:22:05.161 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:22:05.174 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:22:05.175 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:22:05.176 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:22:05.177 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:22:05.179 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:22:05.181 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:22:05.182 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:22:05.245 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-21T07:22:05.261 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-09-21T07:22:05.261 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-09-21T07:22:05.261 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-09-21T07:22:05.261 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-21T07:22:05.261 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:22:05.262 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:22:05.263 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:22:05.264 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:22:05.265 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:22:05.266 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:22:05.267 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:22:05.268 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:22:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:22:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:22:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:22:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:22:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:22:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:22:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout:======================================================================================= 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout:Install 149 Packages 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 8 Packages 2024-09-21T07:22:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:05.277 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 228 M 2024-09-21T07:22:05.277 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-21T07:22:05.828 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:22:05.829 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:22:05.843 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:22:05.844 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:22:05.845 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:22:05.846 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:22:05.849 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:22:05.851 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:22:05.852 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:22:05.915 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout:======================================================================================= 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout:======================================================================================= 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:22:05.944 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:22:05.945 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:22:05.946 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:22:05.947 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:22:05.948 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:22:05.949 INFO:teuthology.orchestra.run.smithi187.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:22:05.950 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:22:05.951 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:22:05.952 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:22:05.953 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:22:05.954 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:22:05.955 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout:Installing weak dependencies: 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-09-21T07:22:05.956 INFO:teuthology.orchestra.run.smithi187.stdout:======================================================================================= 2024-09-21T07:22:05.957 INFO:teuthology.orchestra.run.smithi187.stdout:Install 149 Packages 2024-09-21T07:22:05.957 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 8 Packages 2024-09-21T07:22:05.957 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:22:05.957 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 228 M 2024-09-21T07:22:05.957 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-09-21T07:22:06.142 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:22:06.143 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T07:22:06.155 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T07:22:06.156 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T07:22:06.157 INFO:teuthology.orchestra.run.smithi123.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-21T07:22:06.157 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T07:22:06.158 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T07:22:06.160 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T07:22:06.162 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T07:22:06.163 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T07:22:06.231 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T07:22:06.250 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-21T07:22:06.250 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T07:22:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T07:22:06.252 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T07:22:06.253 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T07:22:06.254 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T07:22:06.255 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T07:22:06.256 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T07:22:06.257 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T07:22:06.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T07:22:06.261 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T07:22:06.261 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T07:22:06.261 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T07:22:06.262 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T07:22:06.263 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T07:22:06.264 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T07:22:06.265 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout:Install 149 Packages 2024-09-21T07:22:06.266 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-09-21T07:22:06.267 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:22:06.267 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 228 M 2024-09-21T07:22:06.267 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T07:22:06.341 INFO:teuthology.orchestra.run.smithi123.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T07:22:06.416 INFO:teuthology.orchestra.run.smithi123.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T07:22:06.516 INFO:teuthology.orchestra.run.smithi123.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T07:22:06.616 INFO:teuthology.orchestra.run.smithi123.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T07:22:06.658 INFO:teuthology.orchestra.run.smithi123.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T07:22:06.909 INFO:teuthology.orchestra.run.smithi187.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-09-21T07:22:06.967 INFO:teuthology.orchestra.run.smithi123.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.0 MB 00:00 2024-09-21T07:22:07.099 INFO:teuthology.orchestra.run.smithi060.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-09-21T07:22:07.267 INFO:teuthology.orchestra.run.smithi123.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T07:22:07.317 INFO:teuthology.orchestra.run.smithi123.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T07:22:07.708 INFO:teuthology.orchestra.run.smithi060.stdout:(2/157): ceph-base-19.3.0-5120.g18432218.el9.x8 6.2 MB/s | 5.5 MB 00:00 2024-09-21T07:22:07.726 INFO:teuthology.orchestra.run.smithi123.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 14 MB/s | 10 MB 00:00 2024-09-21T07:22:07.733 INFO:teuthology.orchestra.run.smithi060.stdout:(3/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.3 MB/s | 873 kB 00:00 2024-09-21T07:22:07.758 INFO:teuthology.orchestra.run.smithi060.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T07:22:07.893 INFO:teuthology.orchestra.run.smithi123.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T07:22:07.902 INFO:teuthology.orchestra.run.smithi060.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T07:22:07.917 INFO:teuthology.orchestra.run.smithi123.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.2 MB/s | 226 kB 00:00 2024-09-21T07:22:07.935 INFO:teuthology.orchestra.run.smithi123.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 648 kB/s | 27 kB 00:00 2024-09-21T07:22:07.976 INFO:teuthology.orchestra.run.smithi187.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 819 kB/s | 873 kB 00:01 2024-09-21T07:22:07.976 INFO:teuthology.orchestra.run.smithi123.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 542 kB/s | 32 kB 00:00 2024-09-21T07:22:08.110 INFO:teuthology.orchestra.run.smithi123.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.2 MB/s | 158 kB 00:00 2024-09-21T07:22:08.136 INFO:teuthology.orchestra.run.smithi123.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 3.7 MB/s | 766 kB 00:00 2024-09-21T07:22:08.186 INFO:teuthology.orchestra.run.smithi123.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T07:22:08.218 INFO:teuthology.orchestra.run.smithi187.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 614 kB/s | 148 kB 00:00 2024-09-21T07:22:08.227 INFO:teuthology.orchestra.run.smithi123.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T07:22:08.286 INFO:teuthology.orchestra.run.smithi123.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 772 kB/s | 45 kB 00:00 2024-09-21T07:22:08.345 INFO:teuthology.orchestra.run.smithi123.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T07:22:08.409 INFO:teuthology.orchestra.run.smithi060.stdout:(6/157): ceph-common-19.3.0-5120.g18432218.el9. 13 MB/s | 20 MB 00:01 2024-09-21T07:22:08.453 INFO:teuthology.orchestra.run.smithi123.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T07:22:08.476 INFO:teuthology.orchestra.run.smithi060.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 8.6 MB/s | 5.0 MB 00:00 2024-09-21T07:22:08.479 INFO:teuthology.orchestra.run.smithi123.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.2 MB/s | 161 kB 00:00 2024-09-21T07:22:08.512 INFO:teuthology.orchestra.run.smithi123.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.3 MB/s | 321 kB 00:00 2024-09-21T07:22:08.543 INFO:teuthology.orchestra.run.smithi060.stdout:(8/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 2.3 MB 00:00 2024-09-21T07:22:08.563 INFO:teuthology.orchestra.run.smithi123.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.6 MB/s | 307 kB 00:00 2024-09-21T07:22:08.588 INFO:teuthology.orchestra.run.smithi123.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.3 MB/s | 99 kB 00:00 2024-09-21T07:22:08.609 INFO:teuthology.orchestra.run.smithi060.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 378 kB/s | 25 kB 00:00 2024-09-21T07:22:08.647 INFO:teuthology.orchestra.run.smithi123.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-21T07:22:08.922 INFO:teuthology.orchestra.run.smithi123.stdout:(27/157): rbd-mirror-19.3.0-5120.g18432218.el9. 9.3 MB/s | 3.1 MB 00:00 2024-09-21T07:22:08.997 INFO:teuthology.orchestra.run.smithi123.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 458 kB/s | 34 kB 00:00 2024-09-21T07:22:09.098 INFO:teuthology.orchestra.run.smithi123.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.5 MB/s | 154 kB 00:00 2024-09-21T07:22:09.252 INFO:teuthology.orchestra.run.smithi060.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 21 MB/s | 18 MB 00:00 2024-09-21T07:22:09.298 INFO:teuthology.orchestra.run.smithi123.stdout:(30/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 261 kB/s | 170 kB 00:00 2024-09-21T07:22:09.318 INFO:teuthology.orchestra.run.smithi060.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T07:22:09.547 INFO:teuthology.orchestra.run.smithi060.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 118 kB/s | 27 kB 00:00 2024-09-21T07:22:09.669 INFO:teuthology.orchestra.run.smithi060.stdout:(13/157): ceph-radosgw-19.3.0-5120.g18432218.el 8.7 MB/s | 10 MB 00:01 2024-09-21T07:22:09.694 INFO:teuthology.orchestra.run.smithi060.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 216 kB/s | 32 kB 00:00 2024-09-21T07:22:09.761 INFO:teuthology.orchestra.run.smithi060.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T07:22:09.803 INFO:teuthology.orchestra.run.smithi060.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 5.6 MB/s | 766 kB 00:00 2024-09-21T07:22:09.814 INFO:teuthology.orchestra.run.smithi123.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-21T07:22:09.828 INFO:teuthology.orchestra.run.smithi060.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T07:22:09.834 INFO:teuthology.orchestra.run.smithi187.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 5.5 MB 00:03 2024-09-21T07:22:09.965 INFO:teuthology.orchestra.run.smithi123.stdout:(32/157): ceph-mgr-dashboard-19.3.0-5120.g18432 16 MB/s | 14 MB 00:00 2024-09-21T07:22:09.970 INFO:teuthology.orchestra.run.smithi060.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 3.0 MB/s | 507 kB 00:00 2024-09-21T07:22:10.015 INFO:teuthology.orchestra.run.smithi123.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.4 MB/s | 292 kB 00:00 2024-09-21T07:22:10.021 INFO:teuthology.orchestra.run.smithi060.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 901 kB/s | 45 kB 00:00 2024-09-21T07:22:10.040 INFO:teuthology.orchestra.run.smithi123.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 663 kB/s | 49 kB 00:00 2024-09-21T07:22:10.065 INFO:teuthology.orchestra.run.smithi123.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 328 kB/s | 16 kB 00:00 2024-09-21T07:22:10.071 INFO:teuthology.orchestra.run.smithi060.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T07:22:10.090 INFO:teuthology.orchestra.run.smithi123.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.5 MB/s | 285 kB 00:00 2024-09-21T07:22:10.093 INFO:teuthology.orchestra.run.smithi187.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 1.2 MB/s | 2.3 MB 00:01 2024-09-21T07:22:10.124 INFO:teuthology.orchestra.run.smithi123.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T07:22:10.149 INFO:teuthology.orchestra.run.smithi123.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 314 kB/s | 18 kB 00:00 2024-09-21T07:22:10.155 INFO:teuthology.orchestra.run.smithi060.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.3 MB 00:00 2024-09-21T07:22:10.180 INFO:teuthology.orchestra.run.smithi060.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T07:22:10.205 INFO:teuthology.orchestra.run.smithi060.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T07:22:10.230 INFO:teuthology.orchestra.run.smithi060.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T07:22:10.256 INFO:teuthology.orchestra.run.smithi060.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T07:22:10.281 INFO:teuthology.orchestra.run.smithi060.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:22:10.291 INFO:teuthology.orchestra.run.smithi123.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-21T07:22:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T07:22:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 3.0 MB/s | 1.5 MB 00:00 2024-09-21T07:22:10.366 INFO:teuthology.orchestra.run.smithi123.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T07:22:10.415 INFO:teuthology.orchestra.run.smithi060.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T07:22:10.440 INFO:teuthology.orchestra.run.smithi060.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 342 kB/s | 34 kB 00:00 2024-09-21T07:22:10.450 INFO:teuthology.orchestra.run.smithi123.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T07:22:10.466 INFO:teuthology.orchestra.run.smithi060.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T07:22:10.642 INFO:teuthology.orchestra.run.smithi123.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-21T07:22:10.692 INFO:teuthology.orchestra.run.smithi123.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T07:22:10.726 INFO:teuthology.orchestra.run.smithi123.stdout:(44/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-21T07:22:10.751 INFO:teuthology.orchestra.run.smithi123.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-21T07:22:10.809 INFO:teuthology.orchestra.run.smithi123.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T07:22:10.849 INFO:teuthology.orchestra.run.smithi060.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 19 MB/s | 7.4 MB 00:00 2024-09-21T07:22:10.860 INFO:teuthology.orchestra.run.smithi123.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 934 kB/s | 125 kB 00:00 2024-09-21T07:22:10.908 INFO:teuthology.orchestra.run.smithi060.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T07:22:10.944 INFO:teuthology.orchestra.run.smithi123.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-09-21T07:22:10.966 INFO:teuthology.orchestra.run.smithi060.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 849 kB/s | 49 kB 00:00 2024-09-21T07:22:10.985 INFO:teuthology.orchestra.run.smithi123.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-21T07:22:11.025 INFO:teuthology.orchestra.run.smithi060.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T07:22:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T07:22:11.084 INFO:teuthology.orchestra.run.smithi060.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T07:22:11.119 INFO:teuthology.orchestra.run.smithi123.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-21T07:22:11.167 INFO:teuthology.orchestra.run.smithi060.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T07:22:11.169 INFO:teuthology.orchestra.run.smithi123.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-09-21T07:22:11.226 INFO:teuthology.orchestra.run.smithi060.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 317 kB/s | 18 kB 00:00 2024-09-21T07:22:11.303 INFO:teuthology.orchestra.run.smithi123.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 2.1 MB/s | 943 kB 00:00 2024-09-21T07:22:11.353 INFO:teuthology.orchestra.run.smithi123.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-21T07:22:11.404 INFO:teuthology.orchestra.run.smithi123.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T07:22:11.512 INFO:teuthology.orchestra.run.smithi123.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T07:22:11.526 INFO:teuthology.orchestra.run.smithi060.stdout:(38/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T07:22:11.588 INFO:teuthology.orchestra.run.smithi123.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.2 MB/s | 3.0 MB 00:00 2024-09-21T07:22:11.646 INFO:teuthology.orchestra.run.smithi123.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T07:22:11.671 INFO:teuthology.orchestra.run.smithi123.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-21T07:22:11.818 INFO:teuthology.orchestra.run.smithi187.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 3.9 MB/s | 20 MB 00:05 2024-09-21T07:22:11.902 INFO:teuthology.orchestra.run.smithi187.stdout:(8/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 2.7 MB/s | 5.0 MB 00:01 2024-09-21T07:22:11.935 INFO:teuthology.orchestra.run.smithi187.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 762 kB/s | 25 kB 00:00 2024-09-21T07:22:12.022 INFO:teuthology.orchestra.run.smithi123.stdout:(60/157): ceph-test-19.3.0-5120.g18432218.el9.x 8.5 MB/s | 40 MB 00:04 2024-09-21T07:22:12.064 INFO:teuthology.orchestra.run.smithi123.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-21T07:22:12.068 INFO:teuthology.orchestra.run.smithi060.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 95 kB/s | 80 kB 00:00 2024-09-21T07:22:12.123 INFO:teuthology.orchestra.run.smithi123.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-09-21T07:22:12.148 INFO:teuthology.orchestra.run.smithi123.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 196 kB/s | 24 kB 00:00 2024-09-21T07:22:12.173 INFO:teuthology.orchestra.run.smithi123.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-21T07:22:12.198 INFO:teuthology.orchestra.run.smithi123.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T07:22:12.232 INFO:teuthology.orchestra.run.smithi123.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T07:22:12.257 INFO:teuthology.orchestra.run.smithi123.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 459 kB/s | 38 kB 00:00 2024-09-21T07:22:12.460 INFO:teuthology.orchestra.run.smithi060.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 859 kB/s | 801 kB 00:00 2024-09-21T07:22:12.532 INFO:teuthology.orchestra.run.smithi123.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-09-21T07:22:12.699 INFO:teuthology.orchestra.run.smithi123.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-21T07:22:12.749 INFO:teuthology.orchestra.run.smithi123.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-21T07:22:12.808 INFO:teuthology.orchestra.run.smithi123.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 8.1 MB/s | 4.9 MB 00:00 2024-09-21T07:22:12.844 INFO:teuthology.orchestra.run.smithi060.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 247 kB/s | 191 kB 00:00 2024-09-21T07:22:12.966 INFO:teuthology.orchestra.run.smithi123.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-21T07:22:13.017 INFO:teuthology.orchestra.run.smithi123.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T07:22:13.036 INFO:teuthology.orchestra.run.smithi187.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 8.6 MB/s | 10 MB 00:01 2024-09-21T07:22:13.086 INFO:teuthology.orchestra.run.smithi187.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.5 MB/s | 226 kB 00:00 2024-09-21T07:22:13.128 INFO:teuthology.orchestra.run.smithi187.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 650 kB/s | 27 kB 00:00 2024-09-21T07:22:13.170 INFO:teuthology.orchestra.run.smithi187.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 767 kB/s | 32 kB 00:00 2024-09-21T07:22:13.213 INFO:teuthology.orchestra.run.smithi123.stdout:(74/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-09-21T07:22:13.244 INFO:teuthology.orchestra.run.smithi060.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 323 kB/s | 253 kB 00:00 2024-09-21T07:22:13.267 INFO:teuthology.orchestra.run.smithi123.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.1 MB/s | 61 kB 00:00 2024-09-21T07:22:13.287 INFO:teuthology.orchestra.run.smithi187.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.4 MB/s | 766 kB 00:00 2024-09-21T07:22:13.345 INFO:teuthology.orchestra.run.smithi187.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T07:22:13.351 INFO:teuthology.orchestra.run.smithi123.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T07:22:13.396 INFO:teuthology.orchestra.run.smithi187.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T07:22:13.435 INFO:teuthology.orchestra.run.smithi123.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-21T07:22:13.485 INFO:teuthology.orchestra.run.smithi123.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-09-21T07:22:13.487 INFO:teuthology.orchestra.run.smithi187.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T07:22:13.535 INFO:teuthology.orchestra.run.smithi123.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-21T07:22:13.593 INFO:teuthology.orchestra.run.smithi123.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T07:22:13.644 INFO:teuthology.orchestra.run.smithi123.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-21T07:22:13.738 INFO:teuthology.orchestra.run.smithi187.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 5.3 MB/s | 18 MB 00:03 2024-09-21T07:22:13.769 INFO:teuthology.orchestra.run.smithi060.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-21T07:22:13.780 INFO:teuthology.orchestra.run.smithi187.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.1 MB/s | 45 kB 00:00 2024-09-21T07:22:13.830 INFO:teuthology.orchestra.run.smithi187.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T07:22:13.861 INFO:teuthology.orchestra.run.smithi123.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-09-21T07:22:13.889 INFO:teuthology.orchestra.run.smithi187.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T07:22:13.961 INFO:teuthology.orchestra.run.smithi123.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-21T07:22:13.964 INFO:teuthology.orchestra.run.smithi187.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T07:22:14.036 INFO:teuthology.orchestra.run.smithi123.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-09-21T07:22:14.039 INFO:teuthology.orchestra.run.smithi187.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T07:22:14.087 INFO:teuthology.orchestra.run.smithi123.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-21T07:22:14.089 INFO:teuthology.orchestra.run.smithi187.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T07:22:14.103 INFO:teuthology.orchestra.run.smithi123.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T07:22:14.128 INFO:teuthology.orchestra.run.smithi123.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T07:22:14.140 INFO:teuthology.orchestra.run.smithi187.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T07:22:14.179 INFO:teuthology.orchestra.run.smithi123.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T07:22:14.204 INFO:teuthology.orchestra.run.smithi123.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-21T07:22:14.228 INFO:teuthology.orchestra.run.smithi060.stdout:(44/157): ceph-test-19.3.0-5120.g18432218.el9.x 7.1 MB/s | 40 MB 00:05 2024-09-21T07:22:14.240 INFO:teuthology.orchestra.run.smithi187.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 5.3 MB 00:00 2024-09-21T07:22:14.246 INFO:teuthology.orchestra.run.smithi123.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T07:22:14.253 INFO:teuthology.orchestra.run.smithi060.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 106 kB/s | 106 kB 00:01 2024-09-21T07:22:14.271 INFO:teuthology.orchestra.run.smithi123.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-21T07:22:14.290 INFO:teuthology.orchestra.run.smithi187.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T07:22:14.332 INFO:teuthology.orchestra.run.smithi187.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 828 kB/s | 34 kB 00:00 2024-09-21T07:22:14.347 INFO:teuthology.orchestra.run.smithi123.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 5.1 MB 00:00 2024-09-21T07:22:14.372 INFO:teuthology.orchestra.run.smithi123.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-09-21T07:22:14.383 INFO:teuthology.orchestra.run.smithi187.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T07:22:14.397 INFO:teuthology.orchestra.run.smithi123.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-21T07:22:14.422 INFO:teuthology.orchestra.run.smithi123.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-09-21T07:22:14.448 INFO:teuthology.orchestra.run.smithi123.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T07:22:14.473 INFO:teuthology.orchestra.run.smithi123.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T07:22:14.498 INFO:teuthology.orchestra.run.smithi123.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-21T07:22:14.549 INFO:teuthology.orchestra.run.smithi123.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T07:22:14.574 INFO:teuthology.orchestra.run.smithi123.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-21T07:22:14.591 INFO:teuthology.orchestra.run.smithi123.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-21T07:22:14.600 INFO:teuthology.orchestra.run.smithi187.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.8 MB/s | 3.1 MB 00:00 2024-09-21T07:22:14.625 INFO:teuthology.orchestra.run.smithi123.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T07:22:14.650 INFO:teuthology.orchestra.run.smithi123.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-21T07:22:14.837 INFO:teuthology.orchestra.run.smithi060.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 127 kB/s | 135 kB 00:01 2024-09-21T07:22:14.920 INFO:teuthology.orchestra.run.smithi060.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 180 kB/s | 125 kB 00:00 2024-09-21T07:22:15.021 INFO:teuthology.orchestra.run.smithi060.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 280 kB/s | 215 kB 00:00 2024-09-21T07:22:15.113 INFO:teuthology.orchestra.run.smithi060.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-21T07:22:15.163 INFO:teuthology.orchestra.run.smithi060.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T07:22:15.208 INFO:teuthology.orchestra.run.smithi123.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-09-21T07:22:15.213 INFO:teuthology.orchestra.run.smithi060.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 556 kB/s | 107 kB 00:00 2024-09-21T07:22:15.247 INFO:teuthology.orchestra.run.smithi060.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-21T07:22:15.258 INFO:teuthology.orchestra.run.smithi123.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T07:22:15.272 INFO:teuthology.orchestra.run.smithi060.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T07:22:15.284 INFO:teuthology.orchestra.run.smithi123.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T07:22:15.309 INFO:teuthology.orchestra.run.smithi123.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T07:22:15.339 INFO:teuthology.orchestra.run.smithi060.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-21T07:22:15.356 INFO:teuthology.orchestra.run.smithi060.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-21T07:22:15.381 INFO:teuthology.orchestra.run.smithi060.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-21T07:22:15.409 INFO:teuthology.orchestra.run.smithi123.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-21T07:22:15.416 INFO:teuthology.orchestra.run.smithi187.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 9.0 MB/s | 7.4 MB 00:00 2024-09-21T07:22:15.434 INFO:teuthology.orchestra.run.smithi123.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T07:22:15.448 INFO:teuthology.orchestra.run.smithi060.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T07:22:15.460 INFO:teuthology.orchestra.run.smithi123.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:22:15.485 INFO:teuthology.orchestra.run.smithi123.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T07:22:15.498 INFO:teuthology.orchestra.run.smithi060.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.2 MB/s | 171 kB 00:00 2024-09-21T07:22:15.500 INFO:teuthology.orchestra.run.smithi187.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.4 MB/s | 292 kB 00:00 2024-09-21T07:22:15.510 INFO:teuthology.orchestra.run.smithi123.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T07:22:15.523 INFO:teuthology.orchestra.run.smithi060.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-21T07:22:15.544 INFO:teuthology.orchestra.run.smithi123.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T07:22:15.566 INFO:teuthology.orchestra.run.smithi187.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 754 kB/s | 49 kB 00:00 2024-09-21T07:22:15.577 INFO:teuthology.orchestra.run.smithi123.stdout:(114/157): protobuf-compiler-3.14.0-13.el9.x86_ 931 kB/s | 863 kB 00:00 2024-09-21T07:22:15.616 INFO:teuthology.orchestra.run.smithi060.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T07:22:15.617 INFO:teuthology.orchestra.run.smithi187.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 322 kB/s | 16 kB 00:00 2024-09-21T07:22:15.619 INFO:teuthology.orchestra.run.smithi123.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-21T07:22:15.645 INFO:teuthology.orchestra.run.smithi123.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-21T07:22:15.649 INFO:teuthology.orchestra.run.smithi060.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-21T07:22:15.670 INFO:teuthology.orchestra.run.smithi123.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-09-21T07:22:15.675 INFO:teuthology.orchestra.run.smithi060.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T07:22:15.695 INFO:teuthology.orchestra.run.smithi123.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T07:22:15.700 INFO:teuthology.orchestra.run.smithi060.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T07:22:15.720 INFO:teuthology.orchestra.run.smithi123.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T07:22:15.746 INFO:teuthology.orchestra.run.smithi123.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T07:22:15.758 INFO:teuthology.orchestra.run.smithi060.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-21T07:22:15.771 INFO:teuthology.orchestra.run.smithi123.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T07:22:15.784 INFO:teuthology.orchestra.run.smithi187.stdout:(35/157): ceph-mgr-dashboard-19.3.0-5120.g18432 10 MB/s | 14 MB 00:01 2024-09-21T07:22:15.797 INFO:teuthology.orchestra.run.smithi123.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T07:22:15.809 INFO:teuthology.orchestra.run.smithi060.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2024-09-21T07:22:15.809 INFO:teuthology.orchestra.run.smithi187.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.5 MB/s | 285 kB 00:00 2024-09-21T07:22:15.822 INFO:teuthology.orchestra.run.smithi123.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T07:22:15.839 INFO:teuthology.orchestra.run.smithi123.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-21T07:22:15.850 INFO:teuthology.orchestra.run.smithi060.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-21T07:22:15.851 INFO:teuthology.orchestra.run.smithi187.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 444 kB/s | 18 kB 00:00 2024-09-21T07:22:15.864 INFO:teuthology.orchestra.run.smithi123.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 703 kB/s | 18 kB 00:00 2024-09-21T07:22:15.881 INFO:teuthology.orchestra.run.smithi123.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T07:22:15.894 INFO:teuthology.orchestra.run.smithi187.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.0 MB/s | 784 kB 00:00 2024-09-21T07:22:15.898 INFO:teuthology.orchestra.run.smithi123.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T07:22:15.915 INFO:teuthology.orchestra.run.smithi123.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T07:22:15.965 INFO:teuthology.orchestra.run.smithi123.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-21T07:22:15.982 INFO:teuthology.orchestra.run.smithi123.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T07:22:15.985 INFO:teuthology.orchestra.run.smithi187.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-21T07:22:15.999 INFO:teuthology.orchestra.run.smithi123.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-09-21T07:22:16.024 INFO:teuthology.orchestra.run.smithi123.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:22:16.044 INFO:teuthology.orchestra.run.smithi187.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T07:22:16.058 INFO:teuthology.orchestra.run.smithi123.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-21T07:22:16.078 INFO:teuthology.orchestra.run.smithi187.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-21T07:22:16.083 INFO:teuthology.orchestra.run.smithi123.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-21T07:22:16.103 INFO:teuthology.orchestra.run.smithi187.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T07:22:16.108 INFO:teuthology.orchestra.run.smithi123.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-21T07:22:16.134 INFO:teuthology.orchestra.run.smithi123.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T07:22:16.154 INFO:teuthology.orchestra.run.smithi187.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T07:22:16.159 INFO:teuthology.orchestra.run.smithi123.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T07:22:16.184 INFO:teuthology.orchestra.run.smithi123.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-21T07:22:16.210 INFO:teuthology.orchestra.run.smithi123.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:22:16.221 INFO:teuthology.orchestra.run.smithi187.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T07:22:16.235 INFO:teuthology.orchestra.run.smithi123.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T07:22:16.260 INFO:teuthology.orchestra.run.smithi123.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-21T07:22:16.279 INFO:teuthology.orchestra.run.smithi187.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T07:22:16.285 INFO:teuthology.orchestra.run.smithi123.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T07:22:16.310 INFO:teuthology.orchestra.run.smithi123.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T07:22:16.336 INFO:teuthology.orchestra.run.smithi123.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T07:22:16.346 INFO:teuthology.orchestra.run.smithi187.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T07:22:16.361 INFO:teuthology.orchestra.run.smithi123.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-21T07:22:16.386 INFO:teuthology.orchestra.run.smithi123.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-21T07:22:16.412 INFO:teuthology.orchestra.run.smithi123.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T07:22:16.413 INFO:teuthology.orchestra.run.smithi187.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-21T07:22:16.451 INFO:teuthology.orchestra.run.smithi060.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-21T07:22:16.462 INFO:teuthology.orchestra.run.smithi123.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T07:22:16.530 INFO:teuthology.orchestra.run.smithi187.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-21T07:22:16.572 INFO:teuthology.orchestra.run.smithi187.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-21T07:22:16.606 INFO:teuthology.orchestra.run.smithi187.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-21T07:22:16.631 INFO:teuthology.orchestra.run.smithi187.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-21T07:22:16.656 INFO:teuthology.orchestra.run.smithi187.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T07:22:16.682 INFO:teuthology.orchestra.run.smithi187.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-21T07:22:16.724 INFO:teuthology.orchestra.run.smithi187.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-21T07:22:16.729 INFO:teuthology.orchestra.run.smithi123.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T07:22:16.774 INFO:teuthology.orchestra.run.smithi187.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-09-21T07:22:16.796 INFO:teuthology.orchestra.run.smithi123.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.8 MB/s | 3.4 MB 00:00 2024-09-21T07:22:16.799 INFO:teuthology.orchestra.run.smithi187.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-21T07:22:16.824 INFO:teuthology.orchestra.run.smithi187.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T07:22:16.850 INFO:teuthology.orchestra.run.smithi187.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T07:22:16.875 INFO:teuthology.orchestra.run.smithi187.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-21T07:22:16.917 INFO:teuthology.orchestra.run.smithi187.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T07:22:16.950 INFO:teuthology.orchestra.run.smithi187.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-21T07:22:16.976 INFO:teuthology.orchestra.run.smithi187.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T07:22:17.001 INFO:teuthology.orchestra.run.smithi187.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T07:22:17.027 INFO:teuthology.orchestra.run.smithi187.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T07:22:17.060 INFO:teuthology.orchestra.run.smithi187.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T07:22:17.063 INFO:teuthology.orchestra.run.smithi123.stdout:(151/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-09-21T07:22:17.085 INFO:teuthology.orchestra.run.smithi187.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-21T07:22:17.121 INFO:teuthology.orchestra.run.smithi123.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 704 kB/s | 41 kB 00:00 2024-09-21T07:22:17.155 INFO:teuthology.orchestra.run.smithi123.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-09-21T07:22:17.180 INFO:teuthology.orchestra.run.smithi123.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.1 MB/s | 249 kB 00:00 2024-09-21T07:22:17.195 INFO:teuthology.orchestra.run.smithi187.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T07:22:17.222 INFO:teuthology.orchestra.run.smithi123.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.7 MB/s | 2.3 MB 00:00 2024-09-21T07:22:17.234 INFO:teuthology.orchestra.run.smithi060.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-21T07:22:17.269 INFO:teuthology.orchestra.run.smithi187.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-21T07:22:17.311 INFO:teuthology.orchestra.run.smithi187.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T07:22:17.362 INFO:teuthology.orchestra.run.smithi187.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-21T07:22:17.387 INFO:teuthology.orchestra.run.smithi187.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-21T07:22:17.389 INFO:teuthology.orchestra.run.smithi123.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-21T07:22:17.437 INFO:teuthology.orchestra.run.smithi187.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-09-21T07:22:17.451 INFO:teuthology.orchestra.run.smithi060.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-09-21T07:22:17.485 INFO:teuthology.orchestra.run.smithi060.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 3.6 MB/s | 910 kB 00:00 2024-09-21T07:22:17.513 INFO:teuthology.orchestra.run.smithi187.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-09-21T07:22:17.538 INFO:teuthology.orchestra.run.smithi187.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-09-21T07:22:17.588 INFO:teuthology.orchestra.run.smithi187.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T07:22:17.589 INFO:teuthology.orchestra.run.smithi123.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.9 MB/s | 2.4 MB 00:00 2024-09-21T07:22:17.594 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:22:17.594 INFO:teuthology.orchestra.run.smithi123.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T07:22:17.635 INFO:teuthology.orchestra.run.smithi060.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.7 MB/s | 4.9 MB 00:01 2024-09-21T07:22:17.660 INFO:teuthology.orchestra.run.smithi060.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 658 kB/s | 137 kB 00:00 2024-09-21T07:22:17.680 INFO:teuthology.orchestra.run.smithi187.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-21T07:22:17.706 INFO:teuthology.orchestra.run.smithi187.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T07:22:17.711 INFO:teuthology.orchestra.run.smithi060.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T07:22:17.731 INFO:teuthology.orchestra.run.smithi187.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T07:22:17.756 INFO:teuthology.orchestra.run.smithi187.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-21T07:22:17.782 INFO:teuthology.orchestra.run.smithi187.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T07:22:17.807 INFO:teuthology.orchestra.run.smithi187.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T07:22:17.832 INFO:teuthology.orchestra.run.smithi187.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-21T07:22:18.169 INFO:teuthology.orchestra.run.smithi060.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-21T07:22:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:(83/157): ceph-test-19.3.0-5120.g18432218.el9.x 6.4 MB/s | 40 MB 00:06 2024-09-21T07:22:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 653 kB/s | 250 kB 00:00 2024-09-21T07:22:18.219 INFO:teuthology.orchestra.run.smithi060.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T07:22:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-21T07:22:18.333 INFO:teuthology.orchestra.run.smithi187.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.7 MB/s | 5.1 MB 00:00 2024-09-21T07:22:18.358 INFO:teuthology.orchestra.run.smithi187.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-21T07:22:18.370 INFO:teuthology.orchestra.run.smithi060.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T07:22:18.383 INFO:teuthology.orchestra.run.smithi187.stdout:(88/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-09-21T07:22:18.409 INFO:teuthology.orchestra.run.smithi187.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T07:22:18.434 INFO:teuthology.orchestra.run.smithi187.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T07:22:18.459 INFO:teuthology.orchestra.run.smithi187.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T07:22:18.485 INFO:teuthology.orchestra.run.smithi187.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T07:22:18.510 INFO:teuthology.orchestra.run.smithi187.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-21T07:22:18.512 INFO:teuthology.orchestra.run.smithi060.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-21T07:22:18.535 INFO:teuthology.orchestra.run.smithi187.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T07:22:18.560 INFO:teuthology.orchestra.run.smithi187.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-21T07:22:18.562 INFO:teuthology.orchestra.run.smithi060.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-21T07:22:18.586 INFO:teuthology.orchestra.run.smithi187.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T07:22:18.611 INFO:teuthology.orchestra.run.smithi187.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-21T07:22:18.612 INFO:teuthology.orchestra.run.smithi060.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-21T07:22:18.636 INFO:teuthology.orchestra.run.smithi187.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-21T07:22:18.662 INFO:teuthology.orchestra.run.smithi187.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T07:22:18.687 INFO:teuthology.orchestra.run.smithi187.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T07:22:18.720 INFO:teuthology.orchestra.run.smithi187.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T07:22:18.721 INFO:teuthology.orchestra.run.smithi060.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-21T07:22:18.746 INFO:teuthology.orchestra.run.smithi187.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T07:22:18.771 INFO:teuthology.orchestra.run.smithi187.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-21T07:22:18.772 INFO:teuthology.orchestra.run.smithi060.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T07:22:18.812 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-21T07:22:18.963 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-21T07:22:18.964 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-21T07:22:19.013 INFO:teuthology.orchestra.run.smithi187.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T07:22:19.072 INFO:teuthology.orchestra.run.smithi187.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-21T07:22:19.097 INFO:teuthology.orchestra.run.smithi187.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T07:22:19.122 INFO:teuthology.orchestra.run.smithi187.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-21T07:22:19.231 INFO:teuthology.orchestra.run.smithi187.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T07:22:19.255 INFO:teuthology.orchestra.run.smithi060.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-09-21T07:22:19.256 INFO:teuthology.orchestra.run.smithi187.stdout:(109/157): lua-devel-5.4.4-4.el9.x86_64.rpm 44 kB/s | 22 kB 00:00 2024-09-21T07:22:19.281 INFO:teuthology.orchestra.run.smithi187.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-21T07:22:19.315 INFO:teuthology.orchestra.run.smithi187.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-21T07:22:19.331 INFO:teuthology.orchestra.run.smithi060.stdout:(83/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.1 MB/s | 5.1 MB 00:00 2024-09-21T07:22:19.340 INFO:teuthology.orchestra.run.smithi187.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-09-21T07:22:19.366 INFO:teuthology.orchestra.run.smithi187.stdout:(113/157): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-09-21T07:22:19.399 INFO:teuthology.orchestra.run.smithi187.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T07:22:19.414 INFO:teuthology.orchestra.run.smithi060.stdout:(84/157): postgresql-server-13.16-1.el9.x86_64. 3.0 MB/s | 5.8 MB 00:01 2024-09-21T07:22:19.424 INFO:teuthology.orchestra.run.smithi187.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T07:22:19.439 INFO:teuthology.orchestra.run.smithi060.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-09-21T07:22:19.450 INFO:teuthology.orchestra.run.smithi187.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T07:22:19.473 INFO:teuthology.orchestra.run.smithi060.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-21T07:22:19.475 INFO:teuthology.orchestra.run.smithi187.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T07:22:19.498 INFO:teuthology.orchestra.run.smithi060.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-21T07:22:19.500 INFO:teuthology.orchestra.run.smithi187.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-21T07:22:19.523 INFO:teuthology.orchestra.run.smithi060.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 708 kB/s | 77 kB 00:00 2024-09-21T07:22:19.525 INFO:teuthology.orchestra.run.smithi187.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T07:22:19.549 INFO:teuthology.orchestra.run.smithi060.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T07:22:19.559 INFO:teuthology.orchestra.run.smithi187.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T07:22:19.574 INFO:teuthology.orchestra.run.smithi060.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T07:22:19.599 INFO:teuthology.orchestra.run.smithi060.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-21T07:22:19.609 INFO:teuthology.orchestra.run.smithi187.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-21T07:22:19.616 INFO:teuthology.orchestra.run.smithi060.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-09-21T07:22:19.633 INFO:teuthology.orchestra.run.smithi060.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 914 kB/s | 54 kB 00:00 2024-09-21T07:22:19.643 INFO:teuthology.orchestra.run.smithi187.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T07:22:19.668 INFO:teuthology.orchestra.run.smithi187.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T07:22:19.675 INFO:teuthology.orchestra.run.smithi060.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-21T07:22:19.692 INFO:teuthology.orchestra.run.smithi060.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-21T07:22:19.693 INFO:teuthology.orchestra.run.smithi187.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T07:22:19.719 INFO:teuthology.orchestra.run.smithi187.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-21T07:22:19.734 INFO:teuthology.orchestra.run.smithi060.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T07:22:19.744 INFO:teuthology.orchestra.run.smithi187.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-21T07:22:19.759 INFO:teuthology.orchestra.run.smithi060.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-21T07:22:19.769 INFO:teuthology.orchestra.run.smithi187.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-21T07:22:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T07:22:19.803 INFO:teuthology.orchestra.run.smithi187.stdout:(128/157): protobuf-compiler-3.14.0-13.el9.x86_ 837 kB/s | 863 kB 00:01 2024-09-21T07:22:19.818 INFO:teuthology.orchestra.run.smithi060.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T07:22:19.843 INFO:teuthology.orchestra.run.smithi060.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-21T07:22:19.845 INFO:teuthology.orchestra.run.smithi187.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-21T07:22:19.869 INFO:teuthology.orchestra.run.smithi060.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T07:22:19.871 INFO:teuthology.orchestra.run.smithi187.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.0 MB/s | 46 kB 00:00 2024-09-21T07:22:19.894 INFO:teuthology.orchestra.run.smithi060.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T07:22:19.896 INFO:teuthology.orchestra.run.smithi187.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T07:22:19.919 INFO:teuthology.orchestra.run.smithi060.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T07:22:19.921 INFO:teuthology.orchestra.run.smithi187.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T07:22:19.955 INFO:teuthology.orchestra.run.smithi187.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T07:22:19.980 INFO:teuthology.orchestra.run.smithi187.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-21T07:22:20.022 INFO:teuthology.orchestra.run.smithi187.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-21T07:22:20.047 INFO:teuthology.orchestra.run.smithi187.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T07:22:20.072 INFO:teuthology.orchestra.run.smithi187.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-21T07:22:20.094 INFO:teuthology.orchestra.run.smithi060.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-21T07:22:20.098 INFO:teuthology.orchestra.run.smithi187.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T07:22:20.119 INFO:teuthology.orchestra.run.smithi060.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-09-21T07:22:20.123 INFO:teuthology.orchestra.run.smithi187.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T07:22:20.178 INFO:teuthology.orchestra.run.smithi060.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-21T07:22:20.204 INFO:teuthology.orchestra.run.smithi060.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-21T07:22:20.237 INFO:teuthology.orchestra.run.smithi060.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-21T07:22:20.242 INFO:teuthology.orchestra.run.smithi187.stdout:(140/157): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-09-21T07:22:20.263 INFO:teuthology.orchestra.run.smithi060.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T07:22:20.274 INFO:teuthology.orchestra.run.smithi187.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 238 kB/s | 36 kB 00:00 2024-09-21T07:22:20.288 INFO:teuthology.orchestra.run.smithi060.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T07:22:20.299 INFO:teuthology.orchestra.run.smithi187.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 833 kB/s | 188 kB 00:00 2024-09-21T07:22:20.313 INFO:teuthology.orchestra.run.smithi060.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T07:22:20.324 INFO:teuthology.orchestra.run.smithi187.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 910 kB/s | 74 kB 00:00 2024-09-21T07:22:20.339 INFO:teuthology.orchestra.run.smithi060.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T07:22:20.350 INFO:teuthology.orchestra.run.smithi187.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T07:22:20.372 INFO:teuthology.orchestra.run.smithi060.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-21T07:22:20.375 INFO:teuthology.orchestra.run.smithi187.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T07:22:20.400 INFO:teuthology.orchestra.run.smithi187.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T07:22:20.422 INFO:teuthology.orchestra.run.smithi060.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-21T07:22:20.425 INFO:teuthology.orchestra.run.smithi187.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:22:20.448 INFO:teuthology.orchestra.run.smithi060.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-21T07:22:20.450 INFO:teuthology.orchestra.run.smithi187.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T07:22:20.473 INFO:teuthology.orchestra.run.smithi060.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T07:22:20.498 INFO:teuthology.orchestra.run.smithi060.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T07:22:20.509 INFO:teuthology.orchestra.run.smithi187.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T07:22:20.524 INFO:teuthology.orchestra.run.smithi060.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T07:22:20.549 INFO:teuthology.orchestra.run.smithi060.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-09-21T07:22:20.574 INFO:teuthology.orchestra.run.smithi060.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T07:22:20.599 INFO:teuthology.orchestra.run.smithi060.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T07:22:20.625 INFO:teuthology.orchestra.run.smithi060.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T07:22:20.650 INFO:teuthology.orchestra.run.smithi060.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T07:22:20.675 INFO:teuthology.orchestra.run.smithi060.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-21T07:22:20.701 INFO:teuthology.orchestra.run.smithi060.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T07:22:20.726 INFO:teuthology.orchestra.run.smithi060.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-21T07:22:20.751 INFO:teuthology.orchestra.run.smithi060.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-21T07:22:20.777 INFO:teuthology.orchestra.run.smithi060.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-21T07:22:20.781 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-21T07:22:20.781 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-21T07:22:20.793 INFO:teuthology.orchestra.run.smithi187.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-21T07:22:20.860 INFO:teuthology.orchestra.run.smithi060.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-21T07:22:20.868 INFO:teuthology.orchestra.run.smithi187.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 7.7 MB/s | 3.4 MB 00:00 2024-09-21T07:22:20.910 INFO:teuthology.orchestra.run.smithi060.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-09-21T07:22:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-09-21T07:22:20.961 INFO:teuthology.orchestra.run.smithi060.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-21T07:22:20.968 INFO:teuthology.orchestra.run.smithi187.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 410 kB/s | 41 kB 00:00 2024-09-21T07:22:20.978 INFO:teuthology.orchestra.run.smithi060.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-09-21T07:22:20.995 INFO:teuthology.orchestra.run.smithi060.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-21T07:22:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T07:22:21.043 INFO:teuthology.orchestra.run.smithi187.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-21T07:22:21.162 INFO:teuthology.orchestra.run.smithi060.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 199 kB/s | 28 kB 00:00 2024-09-21T07:22:21.185 INFO:teuthology.orchestra.run.smithi187.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.4 MB/s | 2.3 MB 00:00 2024-09-21T07:22:21.187 INFO:teuthology.orchestra.run.smithi060.stdout:(137/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-21T07:22:21.221 INFO:teuthology.orchestra.run.smithi060.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-09-21T07:22:21.246 INFO:teuthology.orchestra.run.smithi060.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-21T07:22:21.271 INFO:teuthology.orchestra.run.smithi060.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T07:22:21.277 INFO:teuthology.orchestra.run.smithi187.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.7 MB/s | 1.8 MB 00:00 2024-09-21T07:22:21.313 INFO:teuthology.orchestra.run.smithi060.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 886 kB/s | 59 kB 00:00 2024-09-21T07:22:21.327 INFO:teuthology.orchestra.run.smithi187.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-21T07:22:21.339 INFO:teuthology.orchestra.run.smithi060.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T07:22:21.373 INFO:teuthology.orchestra.run.smithi060.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 736 kB/s | 74 kB 00:00 2024-09-21T07:22:21.398 INFO:teuthology.orchestra.run.smithi060.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T07:22:21.423 INFO:teuthology.orchestra.run.smithi060.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T07:22:21.449 INFO:teuthology.orchestra.run.smithi060.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-21T07:22:21.474 INFO:teuthology.orchestra.run.smithi060.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T07:22:21.499 INFO:teuthology.orchestra.run.smithi060.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T07:22:21.549 INFO:teuthology.orchestra.run.smithi060.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T07:22:21.766 INFO:teuthology.orchestra.run.smithi060.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T07:22:21.861 INFO:teuthology.orchestra.run.smithi187.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-21T07:22:21.866 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:22:21.866 INFO:teuthology.orchestra.run.smithi187.stdout:Total 14 MB/s | 228 MB 00:15 2024-09-21T07:22:21.875 INFO:teuthology.orchestra.run.smithi060.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 8.5 MB/s | 3.4 MB 00:00 2024-09-21T07:22:22.434 INFO:teuthology.orchestra.run.smithi060.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 73 kB/s | 41 kB 00:00 2024-09-21T07:22:22.667 INFO:teuthology.orchestra.run.smithi060.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-09-21T07:22:22.793 INFO:teuthology.orchestra.run.smithi060.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-21T07:22:23.073 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-09-21T07:22:23.224 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-09-21T07:22:23.224 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-09-21T07:22:23.251 INFO:teuthology.orchestra.run.smithi060.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 305 kB/s | 249 kB 00:00 2024-09-21T07:22:23.735 INFO:teuthology.orchestra.run.smithi060.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-21T07:22:23.901 INFO:teuthology.orchestra.run.smithi060.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-21T07:22:23.908 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:22:23.908 INFO:teuthology.orchestra.run.smithi060.stdout:Total 13 MB/s | 228 MB 00:17 2024-09-21T07:22:25.031 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-09-21T07:22:25.031 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-09-21T07:22:25.175 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T07:22:25.347 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T07:22:25.347 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T07:22:27.143 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-21T07:22:27.276 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:22:27.314 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:22:27.370 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:22:27.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:22:27.435 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:22:27.478 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:22:27.810 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:22:27.892 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T07:22:27.892 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T07:22:27.928 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:22:28.052 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:22:28.087 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:22:28.178 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:22:28.208 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:22:28.238 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:22:28.390 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:22:28.447 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:22:28.475 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:22:28.580 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:22:28.610 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:22:28.672 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:22:28.694 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:22:28.713 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:22:28.911 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:22:29.059 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:22:29.183 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:22:29.270 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:29.335 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:29.557 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:29.664 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:22:29.697 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:22:29.732 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:22:29.796 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:22:29.853 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:22:29.885 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:22:29.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:22:29.961 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:22:29.988 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:22:30.057 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:22:30.110 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:22:30.141 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:22:30.185 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:22:30.257 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:22:30.287 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:22:30.330 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:22:30.359 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:22:30.429 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:22:30.474 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:22:30.548 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:22:30.680 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:22:30.743 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:22:31.261 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:22:31.347 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:22:31.376 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:22:31.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:22:31.448 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:22:31.489 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:22:31.534 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-09-21T07:22:31.655 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:22:31.664 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:22:31.709 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:22:31.800 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:22:31.820 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:22:31.856 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:22:31.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:22:31.960 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:22:31.997 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:22:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:22:32.042 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:22:32.043 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:22:32.066 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:22:32.079 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:22:32.110 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:22:32.141 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:22:32.181 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:22:32.316 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:22:32.358 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:22:32.399 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:22:32.458 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:22:32.500 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:22:32.532 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:22:32.572 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:22:32.575 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:22:32.598 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:22:32.700 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:22:32.734 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:22:32.816 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:22:32.847 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:22:32.865 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:22:32.876 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:22:33.027 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:22:33.046 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:22:33.078 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:22:33.106 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:22:33.176 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:22:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:22:33.230 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:22:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:22:33.257 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:22:33.292 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:22:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:22:33.325 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:22:33.331 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:22:33.348 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:22:33.363 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:22:33.392 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:22:33.427 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:22:33.460 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:22:33.501 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:22:33.534 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:22:33.538 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:22:33.624 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:22:33.676 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:22:33.695 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:22:33.716 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:22:33.798 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:22:33.818 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:22:33.867 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:22:33.897 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:33.983 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:34.205 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:34.312 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:22:34.345 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:22:34.380 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:22:34.452 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:22:34.497 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:22:34.523 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T07:22:34.533 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:22:34.576 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:22:34.579 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:22:34.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:22:34.631 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:22:34.637 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:22:34.639 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T07:22:34.665 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:22:34.683 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T07:22:34.704 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:22:34.749 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T07:22:34.759 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:22:34.761 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:22:34.790 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T07:22:34.798 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:22:34.811 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:22:34.815 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T07:22:34.833 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:22:34.855 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:22:34.914 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:22:34.942 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:22:34.953 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:22:34.991 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:22:34.996 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:22:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:22:35.035 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T07:22:35.094 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:22:35.139 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:22:35.174 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:22:35.198 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:22:35.213 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:22:35.274 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:22:35.353 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:22:35.408 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:22:35.577 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T07:22:35.641 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:22:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:22:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:22:35.893 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:22:35.910 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:22:35.922 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:22:35.925 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:22:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T07:22:36.012 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:22:36.029 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:22:36.041 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:22:36.076 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:22:36.114 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:22:36.139 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T07:22:36.155 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:22:36.195 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T07:22:36.222 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:22:36.322 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:22:36.325 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:22:36.348 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:22:36.392 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:22:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T07:22:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:22:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T07:22:36.499 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:22:36.564 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:22:36.636 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:22:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:22:36.669 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:22:36.705 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:22:36.751 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:22:36.788 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:22:36.830 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T07:22:36.831 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:22:36.873 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:22:36.964 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T07:22:37.015 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:22:37.066 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:37.148 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:22:37.149 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:37.208 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:22:37.231 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:22:37.301 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:22:37.309 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:22:37.328 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:22:37.341 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:22:37.381 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:22:37.382 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:22:37.383 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T07:22:37.407 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:22:37.432 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:22:37.505 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:22:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T07:22:37.537 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T07:22:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T07:22:37.631 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:22:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T07:22:37.672 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:22:37.698 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T07:22:37.700 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:22:37.702 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:22:37.734 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:22:37.738 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T07:22:37.741 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:22:37.773 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:22:37.781 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T07:22:37.814 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:22:37.814 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T07:22:37.840 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:22:37.842 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T07:22:37.844 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:22:37.871 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:22:37.878 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:22:37.907 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:22:37.911 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:22:37.922 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T07:22:37.953 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:22:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T07:22:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T07:22:38.055 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T07:22:38.073 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:22:38.073 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:22:38.117 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:22:38.151 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T07:22:38.157 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:22:38.183 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T07:22:38.227 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T07:22:38.254 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T07:22:38.258 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:22:38.307 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:22:38.329 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T07:22:38.387 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T07:22:38.404 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:22:38.427 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:22:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T07:22:38.481 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:22:38.504 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:22:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T07:22:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T07:22:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:22:39.072 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:22:39.122 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:22:39.220 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:22:39.222 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T07:22:39.285 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:22:39.311 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T07:22:39.330 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:22:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T07:22:39.390 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T07:22:39.410 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:22:39.428 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T07:22:39.441 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:22:39.470 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T07:22:39.624 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:22:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T07:22:39.656 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:22:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T07:22:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:22:39.776 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T07:22:39.838 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T07:22:39.912 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T07:22:39.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T07:22:39.985 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T07:22:40.033 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T07:22:40.076 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T07:22:40.119 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T07:22:40.162 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T07:22:40.307 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T07:22:40.347 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T07:22:40.383 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:22:40.388 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T07:22:40.496 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T07:22:40.502 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:22:40.538 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T07:22:40.574 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T07:22:40.625 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T07:22:40.716 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:40.750 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:40.781 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T07:22:41.019 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T07:22:41.299 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T07:22:41.315 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:41.338 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T07:22:41.353 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:22:41.367 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T07:22:41.401 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T07:22:41.430 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:22:41.430 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:22:41.430 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:22:41.430 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:41.440 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T07:22:41.454 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:22:41.480 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T07:22:41.510 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T07:22:41.544 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T07:22:41.594 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T07:22:41.636 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T07:22:41.670 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T07:22:41.697 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:22:41.761 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T07:22:41.778 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:22:41.806 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:22:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T07:22:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T07:22:41.847 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:22:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T07:22:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T07:22:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:22:42.227 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:22:42.309 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:22:42.340 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:22:42.376 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:22:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T07:22:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T07:22:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T07:22:42.875 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:22:42.913 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:22:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T07:22:42.984 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:22:43.014 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:22:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T07:22:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T07:22:43.175 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T07:22:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T07:22:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T07:22:43.439 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T07:22:43.529 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T07:22:44.243 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T07:22:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T07:22:45.505 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:45.536 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:45.701 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T07:22:45.778 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T07:22:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T07:22:45.839 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T07:22:46.100 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:46.139 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:22:46.183 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T07:22:46.229 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:22:46.230 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:22:46.230 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:22:46.230 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:22:46.235 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:22:46.257 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:22:46.328 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T07:22:46.357 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T07:22:46.393 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T07:22:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T07:22:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:22:47.026 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T07:22:47.056 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T07:22:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T07:22:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:22:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T07:22:50.216 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T07:22:50.216 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T07:22:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:22:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:22:53.036 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:22:53.036 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-09-21T07:22:53.036 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-09-21T07:22:53.036 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-09-21T07:22:53.036 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-09-21T07:22:53.036 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-09-21T07:22:53.037 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-09-21T07:22:53.037 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-09-21T07:22:53.037 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:53.214 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:22:53.231 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:22:53.231 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:22:53.231 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:22:53.231 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:54.826 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:22:54.853 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:22:54.853 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:22:54.853 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:22:54.853 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:22:54.853 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:22:54.853 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:55.076 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:22:55.099 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:22:55.100 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:22:55.100 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:22:55.100 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:22:55.100 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:22:55.100 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:55.569 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:22:55.592 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:22:55.592 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:22:55.592 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:22:55.592 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:22:55.592 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:22:55.592 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:22:55.698 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:22:55.756 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:22:55.811 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:22:55.996 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:22:56.044 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:22:56.122 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:22:56.210 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:22:56.349 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:22:56.385 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:22:56.426 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:22:56.454 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:22:56.947 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:22:56.986 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:22:57.010 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:22:57.067 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:22:57.092 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:22:58.047 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /root 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2024-09-21T07:22:58.048 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:22:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:22:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:22:58.234 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:22:58.234 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:22:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:22:59.821 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:22:59.847 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:22:59.847 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:22:59.847 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:22:59.848 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:22:59.848 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:22:59.848 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:00.088 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:23:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:23:00.111 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:00.111 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:23:00.111 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:23:00.111 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:23:00.111 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:00.258 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:23:00.315 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:23:00.580 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:23:00.604 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:23:00.604 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:00.604 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:23:00.604 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:23:00.604 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:23:00.605 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:00.710 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:23:00.758 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:23:00.813 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:23:01.004 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:23:01.055 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:23:01.124 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:23:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:23:01.270 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:23:01.307 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:23:01.358 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:23:01.406 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:23:01.420 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:23:01.437 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:23:01.465 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:23:01.590 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:23:01.617 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:23:01.641 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:01.684 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:23:01.696 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:23:01.794 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:23:01.833 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:23:01.840 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:23:01.864 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:23:01.895 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:23:01.961 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:23:01.987 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-21T07:23:02.601 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-21T07:23:02.602 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:23:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T07:23:02.803 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:02.803 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T07:23:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:02.804 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:23:02.853 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:23:02.877 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:23:02.877 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:02.877 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:23:02.878 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:23:02.878 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:23:02.878 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:02.921 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:23:02.944 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:23:02.944 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:02.944 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:23:02.944 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:02.990 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:23:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:23:03.011 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:03.011 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:23:03.011 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:23:03.011 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:23:03.011 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:03.339 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:23:03.364 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:23:03.364 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:03.364 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:23:03.364 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:23:03.364 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:23:03.364 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:04.454 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:23:04.482 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T07:23:04.483 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:04.483 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T07:23:04.483 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:23:04.483 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T07:23:04.483 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:23:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T07:23:04.747 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:04.747 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T07:23:04.747 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:23:04.747 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T07:23:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:05.143 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:23:05.201 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:23:05.239 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:23:05.264 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T07:23:05.264 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:05.264 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T07:23:05.264 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:23:05.265 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T07:23:05.265 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T07:23:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T07:23:05.501 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T07:23:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T07:23:05.749 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T07:23:05.830 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T07:23:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T07:23:06.080 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T07:23:06.123 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T07:23:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T07:23:06.158 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:23:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T07:23:06.184 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:23:06.297 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:23:06.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:23:06.503 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:23:06.527 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:23:06.527 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:06.528 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:23:06.528 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:23:06.528 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:23:06.528 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:06.571 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:23:06.583 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:23:06.686 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:23:06.690 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:23:06.715 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T07:23:06.736 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:23:06.748 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T07:23:06.816 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T07:23:06.846 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:23:07.318 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:23:07.359 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:23:07.399 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:23:07.441 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:23:07.467 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:23:07.648 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:23:07.689 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:23:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:23:07.719 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:23:07.740 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:23:07.748 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:23:07.764 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:23:07.764 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:07.764 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:23:07.764 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:23:07.764 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:23:07.764 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:07.794 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:23:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:23:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:23:07.831 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:07.831 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:23:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:23:07.915 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:23:07.915 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:07.915 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:23:07.915 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:23:07.915 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:23:07.915 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:08.234 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:23:08.257 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:23:08.257 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:08.257 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:23:08.257 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:23:08.257 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:23:08.257 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:08.356 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:08.392 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:08.412 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:09.242 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:23:09.330 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:23:09.370 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:23:09.451 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:23:09.503 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:23:09.533 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:23:09.559 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:23:09.559 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:23:09.643 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:23:09.643 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:23:09.727 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:23:09.752 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:23:09.757 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:09.757 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:09.937 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:09.937 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:23:10.013 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:23:10.077 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:10.236 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T07:23:10.302 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:23:11.322 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T07:23:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:23:11.475 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T07:23:11.652 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T07:23:11.679 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:23:11.704 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T07:23:11.704 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:11.705 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T07:23:11.705 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:23:11.705 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T07:23:11.705 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:11.755 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:23:11.767 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T07:23:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T07:23:11.958 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T07:23:12.229 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:23:12.270 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:23:12.311 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:23:12.343 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:23:12.370 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:23:12.566 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:23:12.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:23:12.639 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:23:12.669 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:23:12.715 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:23:12.976 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T07:23:13.008 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:23:13.033 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T07:23:13.033 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:13.033 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T07:23:13.033 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:23:13.033 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T07:23:13.033 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:13.075 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:23:13.099 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T07:23:13.099 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:13.099 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T07:23:13.099 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:13.159 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:23:13.183 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T07:23:13.183 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:13.184 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T07:23:13.184 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:23:13.184 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T07:23:13.184 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:13.286 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:13.330 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:13.350 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:13.526 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:23:13.551 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T07:23:13.551 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T07:23:13.551 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T07:23:13.551 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:23:13.551 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T07:23:13.551 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:14.176 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:23:14.259 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:23:14.300 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:23:14.387 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:23:14.429 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:23:14.454 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:23:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:23:14.480 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:23:14.556 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:23:14.556 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:23:14.640 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:23:14.665 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:23:14.670 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:14.670 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:14.867 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:14.867 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:23:14.943 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:23:15.005 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:23:16.376 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:23:16.377 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:23:16.378 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:23:16.379 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:23:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:23:16.381 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:23:16.382 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:23:16.383 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:23:16.384 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:23:16.385 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:23:16.386 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:23:16.387 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:23:16.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:23:16.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:23:16.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:23:16.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:23:16.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:23:16.388 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:23:17.806 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T07:23:17.847 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T07:23:17.888 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T07:23:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T07:23:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T07:23:18.182 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T07:23:18.227 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T07:23:18.257 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T07:23:18.286 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T07:23:18.333 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T07:23:18.833 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:18.833 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:18.834 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-09-21T07:23:18.834 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:18.834 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:18.834 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:18.834 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:18.834 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.835 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.835 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:18.835 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:18.835 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-21T07:23:18.835 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:23:18.835 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:23:18.836 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:23:18.836 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:23:18.836 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.836 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.836 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.836 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.837 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.837 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.837 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.837 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.837 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.837 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.838 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.839 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.839 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.839 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.839 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.839 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.839 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.840 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.840 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:18.840 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:23:18.840 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:23:18.840 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:23:18.840 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:23:18.841 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:23:18.842 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.842 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.842 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.842 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:23:18.842 INFO:teuthology.orchestra.run.smithi123.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:23:18.842 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:23:18.843 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:23:18.843 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:23:18.843 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:23:18.843 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.843 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.843 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:23:18.844 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:23:18.845 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:23:18.846 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:23:18.847 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:23:18.848 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:23:18.849 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:23:18.850 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.851 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:23:18.852 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-21T07:23:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:19.030 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:19.052 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T07:23:19.253 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:19.967 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T07:23:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T07:23:20.105 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T07:23:20.202 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T07:23:20.238 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T07:23:20.264 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T07:23:20.289 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T07:23:20.290 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:23:20.365 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T07:23:20.366 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:23:20.449 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T07:23:20.474 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T07:23:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:20.480 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:20.668 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T07:23:20.668 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:23:20.753 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T07:23:20.821 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:23:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:23:21.248 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:23:21.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:23:21.260 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:23:21.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:23:21.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:23:21.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:23:21.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:23:21.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:23:21.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:23:21.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:23:21.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:23:21.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:23:21.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:24.000 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.001 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.002 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:23:24.003 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:23:24.004 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:23:24.005 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:23:24.006 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:23:24.007 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:23:24.008 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:23:24.009 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:23:24.010 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:23:24.011 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:23:24.012 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:23:24.013 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-09-21T07:23:24.446 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:27.205 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T07:23:27.206 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T07:23:27.207 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T07:23:27.208 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T07:23:27.208 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T07:23:27.208 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T07:23:27.208 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T07:23:27.208 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T07:23:27.220 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T07:23:27.221 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T07:23:27.222 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T07:23:27.223 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T07:23:27.224 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T07:23:27.225 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T07:23:27.226 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T07:23:27.227 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T07:23:27.228 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T07:23:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T07:23:27.230 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.590 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.591 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.592 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T07:23:29.593 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.594 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T07:23:29.595 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.596 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T07:23:29.597 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T07:23:29.598 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T07:23:29.599 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T07:23:29.600 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T07:23:29.601 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T07:23:29.602 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T07:23:29.602 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T07:23:29.602 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T07:23:29.602 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:23:29.602 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T07:23:30.006 DEBUG:teuthology.parallel:result is None 2024-09-21T07:23:30.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:23:30.152 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:23:30.175 INFO:teuthology.orchestra.run.smithi060.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:23:30.175 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:23:30.176 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:23:30.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:23:30.323 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:23:30.350 INFO:teuthology.orchestra.run.smithi123.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:23:30.350 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:23:30.351 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:23:30.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:23:30.490 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T07:23:30.517 INFO:teuthology.orchestra.run.smithi187.stdout:19.3.0-5120.g18432218.el9 2024-09-21T07:23:30.517 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T07:23:30.517 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T07:23:30.519 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T07:23:30.519 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:23:30.519 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:23:30.549 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:23:30.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:23:30.583 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:23:30.583 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T07:23:30.615 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T07:23:30.615 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:23:30.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:23:30.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:23:30.709 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:23:30.709 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:23:30.738 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:23:30.806 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:23:30.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T07:23:30.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T07:23:30.905 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T07:23:30.905 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:23:30.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:23:30.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:23:31.000 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:23:31.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:23:31.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:23:31.095 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:23:31.095 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T07:23:31.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T07:23:31.195 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T07:23:31.195 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:23:31.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:23:31.223 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:23:31.291 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:23:31.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:23:31.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:23:31.385 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:23:31.386 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T07:23:31.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T07:23:31.484 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T07:23:31.600 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T07:23:31.600 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:23:31.601 INFO:tasks.cephadm:Cluster fsid is 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:23:31.601 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T07:23:31.601 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.60', 'mon.b': '172.21.15.123', 'mon.c': '172.21.15.187'} 2024-09-21T07:23:31.601 INFO:tasks.cephadm:First mon is mon.a on smithi060 2024-09-21T07:23:31.601 INFO:tasks.cephadm:First mgr is x 2024-09-21T07:23:31.601 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T07:23:31.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-09-21T07:23:31.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-09-21T07:23:31.659 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s) 2024-09-21T07:23:31.687 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T07:23:31.687 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:23:31.832 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T07:23:31.976 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:23:31.978 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:23:31.978 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T07:23:31.978 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:32.537 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:23 /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:32.538 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.056 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:23 /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.056 DEBUG:teuthology.orchestra.run.smithi187:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.569 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 07:23 /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.569 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.590 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.606 DEBUG:teuthology.orchestra.run.smithi187:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T07:23:33.643 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T07:23:33.643 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:23:33.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:23:33.649 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T07:23:35.123 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:23:35.272 INFO:teuthology.orchestra.run.smithi187.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:23:35.380 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:24:23.381 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T07:24:23.381 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:24:23.381 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:24:23.381 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-09-21T07:24:23.382 INFO:teuthology.orchestra.run.smithi123.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:24:23.382 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-21T07:24:23.382 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T07:24:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:24:26.657 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:24:26.657 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:24:26.658 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-09-21T07:24:26.658 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:24:26.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:24:26.658 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:24:27.056 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T07:24:27.056 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T07:24:27.057 INFO:teuthology.orchestra.run.smithi187.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T07:24:27.057 INFO:teuthology.orchestra.run.smithi187.stdout: "repo_digests": [ 2024-09-21T07:24:27.057 INFO:teuthology.orchestra.run.smithi187.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T07:24:27.057 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-09-21T07:24:27.057 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T07:24:27.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-09-21T07:24:27.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-09-21T07:24:27.145 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph 2024-09-21T07:24:27.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-09-21T07:24:27.199 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-09-21T07:24:27.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /etc/ceph 2024-09-21T07:24:27.252 INFO:tasks.cephadm:Writing seed config... 2024-09-21T07:24:27.253 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T07:24:27.253 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T07:24:27.253 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T07:24:27.254 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T07:24:27.255 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T07:24:27.256 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T07:24:27.256 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:24:27.256 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T07:24:27.273 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 679a927c-77ea-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-21T07:24:27.273 DEBUG:teuthology.orchestra.run.smithi060:mon.a> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T07:24:27.316 DEBUG:teuthology.orchestra.run.smithi060:mgr.x> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T07:24:27.358 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T07:24:27.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.60 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:27.570 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T07:24:27.570 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.60', '--skip-admin-label'] 2024-09-21T07:24:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T07:24:27.570 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying podman|docker is present... 2024-09-21T07:24:27.595 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:24:27.596 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying lvm2 is present... 2024-09-21T07:24:27.596 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying time synchronization is in place... 2024-09-21T07:24:27.603 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:24:27.604 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:24:27.610 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:24:27.610 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T07:24:27.617 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-09-21T07:24:27.624 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-09-21T07:24:27.624 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:24:27.624 INFO:teuthology.orchestra.run.smithi060.stdout:Repeating the final host check... 2024-09-21T07:24:27.647 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-21T07:24:27.647 INFO:teuthology.orchestra.run.smithi060.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T07:24:27.648 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl is present 2024-09-21T07:24:27.648 INFO:teuthology.orchestra.run.smithi060.stdout:lvcreate is present 2024-09-21T07:24:27.654 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T07:24:27.654 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T07:24:27.661 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T07:24:27.661 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T07:24:27.668 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-09-21T07:24:27.674 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-09-21T07:24:27.674 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-09-21T07:24:27.674 INFO:teuthology.orchestra.run.smithi060.stdout:Host looks OK 2024-09-21T07:24:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:Cluster fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:Acquiring lock 140028654235264 on /run/cephadm/679a927c-77ea-11ef-baf5-efdc52797490.lock 2024-09-21T07:24:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:Lock 140028654235264 acquired on /run/cephadm/679a927c-77ea-11ef-baf5-efdc52797490.lock 2024-09-21T07:24:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 3300 ... 2024-09-21T07:24:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 6789 ... 2024-09-21T07:24:27.676 INFO:teuthology.orchestra.run.smithi060.stdout:Base mon IP(s) is [172.21.15.60:3300, 172.21.15.60:6789], mon addrv is [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-21T07:24:27.679 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.60 metric 100 2024-09-21T07:24:27.679 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.60 metric 100 2024-09-21T07:24:27.682 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T07:24:27.682 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T07:24:27.682 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1773sec hoplimit 64 pref medium 2024-09-21T07:24:27.684 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T07:24:27.684 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T07:24:27.684 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:24:27.684 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T07:24:27.685 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-21T07:24:27.685 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T07:24:27.685 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-09-21T07:24:27.685 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-09-21T07:24:27.685 INFO:teuthology.orchestra.run.smithi060.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T07:24:27.686 INFO:teuthology.orchestra.run.smithi060.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T07:24:27.686 INFO:teuthology.orchestra.run.smithi060.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:24:28.260 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:24:28.261 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T07:24:28.261 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T07:24:28.261 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T07:24:28.261 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T07:24:28.261 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T07:24:28.261 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T07:24:29.273 INFO:teuthology.orchestra.run.smithi060.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:24:29.273 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T07:24:29.273 INFO:teuthology.orchestra.run.smithi060.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T07:24:30.280 INFO:teuthology.orchestra.run.smithi060.stdout:stat: stdout 167 167 2024-09-21T07:24:30.281 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial keys... 2024-09-21T07:24:31.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQCudO5mCB1oJhAAS+wTvyuMYkFW8B7/efuICg== 2024-09-21T07:24:32.217 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQCvdO5m7WpIIBAA31eioZf+6PxXCPZ8wZI4kw== 2024-09-21T07:24:33.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQCwdO5m/iERIRAAGr9BIDXI/k9/XOgh4TC+XA== 2024-09-21T07:24:33.090 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial monmap... 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool for a [v2:172.21.15.60:3300,v1:172.21.15.60:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = quincy 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: set fsid to 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:24:34.029 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mon... 2024-09-21T07:24:34.960 INFO:teuthology.orchestra.run.smithi060.stdout:create mon.a on 2024-09-21T07:24:35.169 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T07:24:35.375 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T07:24:35.560 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-679a927c-77ea-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-679a927c-77ea-11ef-baf5-efdc52797490.target. 2024-09-21T07:24:35.561 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-679a927c-77ea-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-679a927c-77ea-11ef-baf5-efdc52797490.target. 2024-09-21T07:24:35.829 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a 2024-09-21T07:24:35.829 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T07:24:35.995 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-679a927c-77ea-11ef-baf5-efdc52797490.target.wants/ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-679a927c-77ea-11ef-baf5-efdc52797490@.service. 2024-09-21T07:24:36.534 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:24:36.534 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T07:24:36.542 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:24:36.543 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T07:24:36.543 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T07:24:36.543 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:24:36.543 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon to start... 2024-09-21T07:24:36.543 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon... 2024-09-21T07:24:37.590 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout id: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout services: 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.547116s) 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout data: 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T07:24:37.591 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T07:24:37.592 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:37.592 INFO:teuthology.orchestra.run.smithi060.stdout:mon is available 2024-09-21T07:24:37.592 INFO:teuthology.orchestra.run.smithi060.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:24:38.655 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:24:38.656 INFO:teuthology.orchestra.run.smithi060.stdout:Generating new minimal ceph.conf... 2024-09-21T07:24:39.659 INFO:teuthology.orchestra.run.smithi060.stdout:Restarting the monitor... 2024-09-21T07:24:39.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:39 smithi060 systemd[1]: Stopping Ceph mon.a for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:24:40.192 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a[30873]: 2024-09-21T07:24:39.934+0000 7fcd0958b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:40.192 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a[30873]: 2024-09-21T07:24:39.934+0000 7fcd0958b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T07:24:40.460 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 podman[31120]: 2024-09-21 07:24:40.190733702 +0000 UTC m=+0.367775499 container died a790a543bc5b9fe8e1ece016ad086e78a70ecd98d00581a42d8ec0c8603a3045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T07:24:40.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 podman[31120]: 2024-09-21 07:24:40.558499295 +0000 UTC m=+0.735541089 container cleanup a790a543bc5b9fe8e1ece016ad086e78a70ecd98d00581a42d8ec0c8603a3045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T07:24:40.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 bash[31120]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a 2024-09-21T07:24:41.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 podman[31132]: 2024-09-21 07:24:40.792741923 +0000 UTC m=+0.601255026 container remove a790a543bc5b9fe8e1ece016ad086e78a70ecd98d00581a42d8ec0c8603a3045 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:41.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 systemd[1]: ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T07:24:41.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 systemd[1]: Stopped Ceph mon.a for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:24:41.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:40 smithi060 systemd[1]: Starting Ceph mon.a for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:24:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 podman[31225]: 2024-09-21 07:24:41.060037544 +0000 UTC m=+0.016383236 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:24:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 podman[31225]: 2024-09-21 07:24:41.168613844 +0000 UTC m=+0.124959567 container create bd8556fbf0995589bf63db708a19e7a4144093d0bfb6323fa1c76561ac9e3a51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:24:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 podman[31225]: 2024-09-21 07:24:41.379462249 +0000 UTC m=+0.335807937 container init bd8556fbf0995589bf63db708a19e7a4144093d0bfb6323fa1c76561ac9e3a51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:41.416 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 podman[31225]: 2024-09-21 07:24:41.38263556 +0000 UTC m=+0.338981237 container start bd8556fbf0995589bf63db708a19e7a4144093d0bfb6323fa1c76561ac9e3a51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T07:24:41.476 INFO:teuthology.orchestra.run.smithi060.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T07:24:41.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:24:41.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:24:41.666 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: pidfile_write: ignore empty --pid-file 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: load: jerasure load: lrc 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Git sha 0 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: DB SUMMARY 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: DB Session ID: AN7XBHJL1P4EOZWK401O 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95742 ; 2024-09-21T07:24:41.667 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.env: 0x564af6fb3d60 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.info_log: 0x564afbdc7360 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.statistics: (nil) 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.use_fsync: 0 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:24:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.db_log_dir: 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.wal_dir: 2024-09-21T07:24:41.669 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.write_buffer_manager: 0x564afbdcbd60 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:24:41.671 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.unordered_write: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.row_cache: None 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.wal_filter: None 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:24:41.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.wal_compression: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:24:41.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_open_files: -1 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:24:41.674 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Compression algorithms supported: 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kZSTD supported: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:24:41.675 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.merge_operator: 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_filter: None 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564afbdc6fa0) 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:24:41.676 INFO:journalctl@ceph.mon.a.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_type: 0 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: data_block_index_type: 0 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_shortening: 1 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: checksum: 4 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: no_block_cache: 0 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache: 0x564af7d8b610 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_options: 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: capacity : 536870912 2024-09-21T07:24:41.677 INFO:journalctl@ceph.mon.a.smithi060.stdout: num_shard_bits : 4 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: strict_capacity_limit : 0 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_compressed: (nil) 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: persistent_cache: (nil) 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_size: 4096 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_size_deviation: 10 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_restart_interval: 16 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_block_restart_interval: 1 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: metadata_block_size: 4096 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: partition_filters: 0 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: use_delta_encoding: 1 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: filter_policy: bloomfilter 2024-09-21T07:24:41.678 INFO:journalctl@ceph.mon.a.smithi060.stdout: whole_key_filtering: 1 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: verify_compression: 0 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: format_version: 5 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: enable_index_compression: 1 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_align: 0 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: max_auto_readahead_size: 262144 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: prepopulate_block_cache: 0 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:24:41.679 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression: NoCompression 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.num_levels: 7 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:24:41.680 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:24:41.681 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:24:41.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:24:41.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:24:41.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.ttl: 2592000 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:24:41.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c370d55a-07f2-4c05-9dee-c827b5bd4d53 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726903481420911, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726903481422821, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91865, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 287, "table_properties": {"data_size": 89912, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11841, "raw_average_key_size": 48, "raw_value_size": 83218, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 246, "num_filter_entries": 246, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726903481, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c370d55a-07f2-4c05-9dee-c827b5bd4d53", "db_session_id": "AN7XBHJL1P4EOZWK401O", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726903481422961, "job": 1, "event": "recovery_finished"} 2024-09-21T07:24:41.686 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564afbdeaa80 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: DB pointer 0x564afcb90000 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** DB Stats ** 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:24:41.687 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: L0 2/0 91.57 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 76.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: Sum 2/0 91.57 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 76.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 76.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 76.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T07:24:41.688 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative compaction: 0.00 GB write, 16.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval compaction: 0.00 GB write, 16.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Block cache BinnedLRUCache@0x564af7d8b610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:24:41.689 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: starting mon.a rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???) e1 preinit fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).mds e1 new map 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).mds e1 print_map 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: e1 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: btime 2024-09-21T07:24:36:496645+0000 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: legacy client fscid: -1 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout: No filesystems configured 2024-09-21T07:24:41.690 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 bash[31225]: bd8556fbf0995589bf63db708a19e7a4144093d0bfb6323fa1c76561ac9e3a51 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 systemd[1]: Started Ceph mon.a for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: monmap epoch 1 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: last_changed 2024-09-21T07:24:33.442014+0000 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: created 2024-09-21T07:24:33.442014+0000 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: min_mon_release 19 (squid) 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: election_strategy: 1 2024-09-21T07:24:41.691 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-21T07:24:41.692 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: fsmap 2024-09-21T07:24:41.692 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T07:24:41.692 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:41 smithi060 ceph-mon[31244]: mgrmap e1: no daemons active 2024-09-21T07:24:42.465 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T07:24:42.486 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:42.486 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mgr... 2024-09-21T07:24:42.487 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T07:24:42.487 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T07:24:42.745 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x 2024-09-21T07:24:42.746 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T07:24:42.895 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-679a927c-77ea-11ef-baf5-efdc52797490.target.wants/ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-679a927c-77ea-11ef-baf5-efdc52797490@.service. 2024-09-21T07:24:43.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:42 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2324378805' entity='client.admin' 2024-09-21T07:24:43.424 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:24:43 smithi060 podman[31457]: 2024-09-21 07:24:43.343070736 +0000 UTC m=+0.317236811 container start cd65c878540b8b5735b02563bbcc0778506181304e3291383cd961873e1a7e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T07:24:43.424 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:24:43 smithi060 bash[31457]: cd65c878540b8b5735b02563bbcc0778506181304e3291383cd961873e1a7e7e 2024-09-21T07:24:43.441 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:24:43.441 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T07:24:43.450 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:24:43.450 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T07:24:43.450 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T07:24:43.450 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T07:24:43.461 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:24:43.461 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T07:24:43.470 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:24:43.470 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T07:24:43.470 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T07:24:43.470 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T07:24:43.471 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr to start... 2024-09-21T07:24:43.471 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr... 2024-09-21T07:24:43.694 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:24:43 smithi060 systemd[1]: Started Ceph mgr.x for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:24:44.255 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:43 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2275523741' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:24:44.536 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:44.536 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:24:44.536 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:24:44.536 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:24:44.536 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:24:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:24:44.538 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:24:44.541 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.542 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:24:36:496645+0000", 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:24:44.543 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:24:36.497615+0000", 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:24:44.544 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (1/15)... 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: Activating manager daemon x 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: mgrmap e2: x(active, starting, since 0.00523773s) 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: Manager daemon x is now available 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:24:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:24:49.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' 2024-09-21T07:24:49.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' 2024-09-21T07:24:49.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:48 smithi060 ceph-mon[31244]: from='mgr.14100 172.21.15.60:0/3358721629' entity='mgr.x' 2024-09-21T07:24:50.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:50 smithi060 ceph-mon[31244]: mgrmap e3: x(active, since 1.00823s) 2024-09-21T07:24:50.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:50 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1685488352' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T07:24:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:51 smithi060 ceph-mon[31244]: mgrmap e4: x(active, since 2s) 2024-09-21T07:24:56.095 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:56.095 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T07:24:56.096 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T07:24:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T07:24:56.098 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T07:24:56.101 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T07:24:36:496645+0000", 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T07:24:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T07:24:36.497615+0000", 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:24:56.103 INFO:teuthology.orchestra.run.smithi060.stdout:mgr is available 2024-09-21T07:24:58.979 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:58 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/18325543' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T07:24:59.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:59.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T07:24:59.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:24:59.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T07:24:59.200 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T07:24:59.201 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T07:24:59.202 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T07:24:59.202 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling cephadm module... 2024-09-21T07:25:00.210 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:24:59 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2404551683' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T07:25:00.211 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:24:59 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: ignoring --setuser ceph since I am not root 2024-09-21T07:25:00.211 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:24:59 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: ignoring --setgroup ceph since I am not root 2024-09-21T07:25:01.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:00 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2404551683' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T07:25:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:00 smithi060 ceph-mon[31244]: mgrmap e5: x(active, since 11s) 2024-09-21T07:25:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:25:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T07:25:01.695 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:25:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:25:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:25:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:25:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-09-21T07:25:01.696 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 5... 2024-09-21T07:25:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:01 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1273575010' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: Active manager daemon x restarted 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: Activating manager daemon x 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: mgrmap e6: x(active, starting, since 0.0036772s) 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:25:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:05 smithi060 ceph-mon[31244]: Manager daemon x is now available 2024-09-21T07:25:06.740 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:25:06.740 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T07:25:06.740 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:25:06.740 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:25:06.740 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 5 is available 2024-09-21T07:25:06.740 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying orchestrator module is enabled... 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: Found migration_current of "None". Setting to last migration. 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:07.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:07.024 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:25:07.024 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:25:07.024 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:06 smithi060 ceph-mon[31244]: mgrmap e7: x(active, since 1.00659s) 2024-09-21T07:25:08.113 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:07 smithi060 ceph-mon[31244]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:25:08.113 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:07 smithi060 ceph-mon[31244]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T07:25:08.113 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:07 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2429137800' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T07:25:08.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:25:08.110+0000 7f968d675640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:25:08] ENGINE Error in HTTPServer.serve 2024-09-21T07:25:08.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: Traceback (most recent call last): 2024-09-21T07:25:08.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:25:08.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self._connections.run(self.expiration_interval) 2024-09-21T07:25:08.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self._run(expiration_interval) 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: s = self.context.wrap_socket( 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: return self.sslsocket_class._create( 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self.do_handshake() 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:25:08.373 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self._sslobj.do_handshake() 2024-09-21T07:25:08.374 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:25:08.374 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:25:08.473 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T07:25:08.473 INFO:teuthology.orchestra.run.smithi060.stdout:Setting orchestrator backend to cephadm... 2024-09-21T07:25:09.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2429137800' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T07:25:09.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-mon[31244]: mgrmap e8: x(active, since 2s) 2024-09-21T07:25:09.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:08 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:07] ENGINE Bus STARTING 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:08] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:08] ENGINE Error in HTTPServer.serve 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: Traceback (most recent call last): 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._run(expiration_interval) 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:25:10.047 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: self.do_handshake() 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:08] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:08] ENGINE Bus STARTED 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:10.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:09 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:10.795 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T07:25:10.795 INFO:teuthology.orchestra.run.smithi060.stdout:Generating ssh key... 2024-09-21T07:25:11.111 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:10 smithi060 ceph-mon[31244]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-mon[31244]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: Generating public/private rsa key pair. 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: Your identification has been saved in /tmp/tmpg_9yzyiw/key 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: Your public key has been saved in /tmp/tmpg_9yzyiw/key.pub 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: The key fingerprint is: 2024-09-21T07:25:12.122 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: SHA256:N9nJqNvk5GC74KTazQIkMR5Id4weahrpmFWhKIVoxw8 ceph-679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: The key's randomart image is: 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: +---[RSA 3072]----+ 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: |+oo.+o | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: |*=.Eo. | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: |=+*.+ | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: |=+o. . = . | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: |=* S = + | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: |+.. o . | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: | . o + o | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: | ..* o X | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: | ..o.+ +.+ | 2024-09-21T07:25:12.123 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: +----[SHA256]-----+ 2024-09-21T07:25:13.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:12 smithi060 ceph-mon[31244]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:13.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:12 smithi060 ceph-mon[31244]: Generating ssh key... 2024-09-21T07:25:13.608 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:25:13.608 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:25:13.609 INFO:teuthology.orchestra.run.smithi060.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T07:25:13.613 INFO:teuthology.orchestra.run.smithi060.stdout:Adding host smithi060... 2024-09-21T07:25:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:14 smithi060 ceph-mon[31244]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:15.215 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:15 smithi060 ceph-mon[31244]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:16.070 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:16 smithi060 ceph-mon[31244]: Deploying cephadm binary to smithi060 2024-09-21T07:25:18.450 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Added host 'smithi060' with addr '172.21.15.60' 2024-09-21T07:25:18.450 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying unmanaged mon service... 2024-09-21T07:25:19.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:18 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:18 smithi060 ceph-mon[31244]: Added host smithi060 2024-09-21T07:25:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:18 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:19.868 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T07:25:19.869 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying unmanaged mgr service... 2024-09-21T07:25:20.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:20 smithi060 ceph-mon[31244]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:20.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:20 smithi060 ceph-mon[31244]: Saving service mon spec with placement count:5 2024-09-21T07:25:20.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:20 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:22.080 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T07:25:22.317 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:22 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:22.317 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:22 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:22.317 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:22 smithi060 ceph-mon[31244]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:22.318 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:22 smithi060 ceph-mon[31244]: Saving service mgr spec with placement count:2 2024-09-21T07:25:22.318 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:22 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:23.905 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4266947380' entity='client.admin' 2024-09-21T07:25:23.905 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:23 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:25.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:24 smithi060 ceph-mon[31244]: from='mgr.14116 172.21.15.60:0/1959122549' entity='mgr.x' 2024-09-21T07:25:25.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:24 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2827253408' entity='client.admin' 2024-09-21T07:25:26.146 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling the dashboard module... 2024-09-21T07:25:26.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:26 smithi060 ceph-mon[31244]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:25:27.513 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:27 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3729222138' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T07:25:27.513 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: ignoring --setuser ceph since I am not root 2024-09-21T07:25:27.514 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: ignoring --setgroup ceph since I am not root 2024-09-21T07:25:28.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:28 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3729222138' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T07:25:28.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:28 smithi060 ceph-mon[31244]: mgrmap e9: x(active, since 22s) 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-09-21T07:25:29.176 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 9... 2024-09-21T07:25:29.298 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:29 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3903669547' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T07:25:32.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: Active manager daemon x restarted 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: Activating manager daemon x 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: mgrmap e10: x(active, starting, since 0.0037875s) 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T07:25:32.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:32 smithi060 ceph-mon[31244]: Manager daemon x is now available 2024-09-21T07:25:33.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:33.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T07:25:33.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T07:25:33.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:33 smithi060 ceph-mon[31244]: mgrmap e11: x(active, since 1.00729s) 2024-09-21T07:25:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-21T07:25:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T07:25:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T07:25:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-21T07:25:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 9 is available 2024-09-21T07:25:34.116 INFO:teuthology.orchestra.run.smithi060.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T07:25:34.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-mon[31244]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T07:25:34.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-mon[31244]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T07:25:35.061 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:25:34.760+0000 7fa247ad4640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:07:25:34] ENGINE Error in HTTPServer.serve 2024-09-21T07:25:35.061 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: Traceback (most recent call last): 2024-09-21T07:25:35.061 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:25:35.061 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self._connections.run(self.expiration_interval) 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self._run(expiration_interval) 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: s = self.context.wrap_socket( 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: return self.sslsocket_class._create( 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self.do_handshake() 2024-09-21T07:25:35.062 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:25:35.063 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: self._sslobj.do_handshake() 2024-09-21T07:25:35.063 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:25:35.063 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:25:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: mgrmap e12: x(active, since 2s) 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:34] ENGINE Bus STARTING 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:34] ENGINE Serving on https://172.21.15.60:7150 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:34] ENGINE Error in HTTPServer.serve 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: Traceback (most recent call last): 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._run(expiration_interval) 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T07:25:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: s = self.context.wrap_socket( 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: return self.sslsocket_class._create( 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: self.do_handshake() 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._sslobj.do_handshake() 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:34] ENGINE Serving on http://172.21.15.60:8765 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: [21/Sep/2024:07:25:34] ENGINE Bus STARTED 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:35.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:36.601 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUHWMohKvt8eVgh/C/3eyx/cwaeE4wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA3MjUzNloXDTM0\nMDkyMjA3MjUzNlowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjYwMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAuDBupkEECheF9/GNuBb8eE1Z55Hv5lHwPSei\nwHFMFv2UhbTMv6noGp1JnhsG4nduihpzoI/EeYUeec8PqaEWB2x/jVwR3l+EVfeS\nUk1qZuFDX42kFAsV5eFgSUojUgArHWQCiBue/R57eZGlIqVuTLijjXLfg74WGizz\nfSlecl54BN44a9AmWxxR/e0rcwhZa1c50axxslbGPocdpS54Y5eNt4cFXfJfc58m\npCflEqskpzIOTTaom6lxbuTPVKP1bX9dYZA1DFhCfvSvBRU2LmxQKEuQZFtRAanH\n8+Bn8E6a0k8khAEaE5gGn8pjlZfeRou+W8ZOeiSlpQH71c8bLKT4Ltde52IVpZ2Q\nFahZEzBKC2eWgYMoQzXZF5kNB4oytAIDsoXc5qm8HgRKqF5ZElhKUGQ/i0xE5pVU\nhSM4e9gACyxgsvUn1QkcntmKt0h2pFtleE9c5A3FEiSrRMf/Up8B9iBv676Jd4Rj\n18AbyfVd5i5rvNWH1kxdh06+/TYgXEPgXhRhmSaDpKrtH8Q8LljQn34yGYrpVdn8\n6wLQPRUgczGlCQtKre0LTXEaHJyyvKk/YqBXWKFpMp3RAR5H+UUQeZoji5u/bNHf\nE/CvYJku6Cw6f6vycar1jYs10pNzF0DPBn8oZK/kMQ61ht0eXSY7uZ3QcW1VxnM+\ngtzb8J8CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDYwghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPPDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAb\n06BMUtfnJZx/xLHAMNzNwf7IOZj/XwOXhh4M7SK/bnffENuyXM/yRTgxQrMaVpUC\nqxPbPptrfiGH2ZQ+LGIXAIJke18XCr64oSS0kljPD4SwTqYFj92rwcuSNehGoLm9\ne55Y5ZkwyDeYQzWHakgZrdDMEIx+Uy3P63L55XP67ERo8eyLBvAqxt/QNlN9HzzO\nwxNid61c8NMeGrHT9P0oebtUWqNNxrDJnNm+xea8/QsSZyKluWX63R+MyaQ6w/KV\nP8JnDCFanM4AUYd038ynIFwwTu1w3aCfQFhES4gkYDFjH0+ccOcNRpqaXICosZ8u\nIpjh280t9Fh/iH/DMpIb2uoErFcND3SzHzIqLsP7h8V8A4sn8anaup6d53O5F6vr\nwsNv39IqmFs1ZQMJfI1Ep5KvXyvrBjxqFOJg7scAU254yV1U75LB8obNwgvNaAGr\nilTWqmnE5KPE/ITMa3r71OcLj0UyQlk0y3OH1wBIJOZqtyG5LNPg/LeThX0E7HFH\nbhZTNjs4hbsBoVZzf4SnYqN9vzOeM6/qtYpdWKky9w4pAkQTd0QKlnTghtnAGZUz\nhEXiSkCT1VOxg82Uie4CWoZxWt6F8OBlF/DRYNgdvGl+Stj80PwjIebGYNEVZBQ4\nQ4GM0u1qC9M/Sr2WFFJaS8b7I470yhjU1Yv9kWJfdQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAuDBupkEECheF9/GNuBb8eE1Z55Hv5lHwPSeiwHFMFv2UhbTM\nv6noGp1JnhsG4nduihpzoI/EeYUeec8PqaEWB2x/jVwR3l+EVfeSUk1qZuFDX42k\nFAsV5eFgSUojUgArHWQCiBue/R57eZGlIqVuTLijjXLfg74WGizzfSlecl54BN44\na9AmWxxR/e0rcwhZa1c50axxslbGPocdpS54Y5eNt4cFXfJfc58mpCflEqskpzIO\nTTaom6lxbuTPVKP1bX9dYZA1DFhCfvSvBRU2LmxQKEuQZFtRAanH8+Bn8E6a0k8k\nhAEaE5gGn8pjlZfeRou+W8ZOeiSlpQH71c8bLKT4Ltde52IVpZ2QFahZEzBKC2eW\ngYMoQzXZF5kNB4oytAIDsoXc5qm8HgRKqF5ZElhKUGQ/i0xE5pVUhSM4e9gACyxg\nsvUn1QkcntmKt0h2pFtleE9c5A3FEiSrRMf/Up8B9iBv676Jd4Rj18AbyfVd5i5r\nvNWH1kxdh06+/TYgXEPgXhRhmSaDpKrtH8Q8LljQn34yGYrpVdn86wLQPRUgczGl\nCQtKre0LTXEaHJyyvKk/YqBXWKFpMp3RAR5H+UUQeZoji5u/bNHfE/CvYJku6Cw6\nf6vycar1jYs10pNzF0DPBn8oZK/kMQ61ht0eXSY7uZ3QcW1VxnM+gtzb8J8CAwEA\nAQKCAgAkIfgq7Dk3I5s34y6ajQPVM9Ntvq7Rv4RB8vsWBoPXRMK0oh3CgbnTMsTk\n28dzeNt6AytotZtk/WzXl3uqmrvAFBRHrmag+Zrz5F/TfnVfnlRBs/8aoXwXvylM\n51rbdMYAe4SVn9mGLUsqs5wyGkLzkQsgrgbUCN+8HdJcXNe21vpzdgaae9hyajFZ\nf4PVCq/EA3YHwG0Df8tfK9FwfJfIbcwy0y2F2wzHmVKSxHLHQUSs+gBdPFpCQzDK\nAN/9aja01tYCVDBb7hqJXkXRWPJqk/v7k6tNTK6tBVoA6SZquXjcxgLTVIYBjwLJ\nqQH1MDg+HZ7n0RTHGFZYcvWs4Xaiat/hXwomxsFVcWHLS/RbIn/7dIMS2nWFRfqP\n/WrnKzmGpZMM9gq5GiuFcp9MPmuvO4VuCpfQTX1FM7/eflY6kCC9WWLKDByuUy88\nfOnlydSoqAldZUkTChk0Wi+SlMGW+3ZdupYHfCQKV4WUv4jYEzdTnbObys7vOSEs\nbN6/Wblywea9sDtWNK2YvtJmUDP6mBUTklq1hxCoJq589LZ+3OtZrv4CypPnBXMs\nzD9REPxHX/6Fuwh6sZ41Anh2rCmfUkxgPkrWgCaV3dOCQAKjGZBjkJqBDNxrjsft\nNTVBmE3fxUt9quTqJcNPEmYK4mjdQ9ypwkp93QuqLLaNjhBmuQKCAQEA+m1bpgt0\nlWgJXny7bjsDd3XBKC8k7geLXQ7VX0u03CsunegKm8K7MBx8+NzUuliAR6NBd+zM\ni3p/vcVbmAICragHDm8LBg0O2Dj0M6Hwx2nVYUuzO8LF6r7hbN/Td/he4bmVatai\nPd3UZ39ZIQuPOpLPijh7nLKoJhLlGT071HH76AzjEpvJsQebbMUlU3ID3UzMWonn\nj6qrLE23wyckl2qDNOj5/4PnWUx+3zD4I7SYVWw93vCApBclemSXtX9jXz1UZWU/\nQZsJhuD/tARsWnbU9hhfFPFXmLcYaB9yyA7Aiz0gweSzpBj3zOHBLyBiCzYhxqB7\nTunW7k9h9QZ9xwKCAQEAvEm6Nuu63QD/kE1khs5NO70z7SLlhHbA9OY3RjtzwFMh\nQEWzGmzcp7e13q5+c8lXXrmGiOKShbMzR3vXuxZHBQXCdtlI73BEoCWhyMH7i5/Z\nhsd+jgrLOrRsFoxGrydiWaAqm+/X+GlR+tCEdAqcrRX2GDGXnMHTODwB0O1n4x0l\n1wrQgAZgazQvTnD+SBVjUgPEVgTjcU9ZR+5E4Hi/YElLgaTgHITI9aY15TsLb+Vf\nv+txG3rcXkZH3ZeeQOdXERHoT7uLZ26HvmpemS6C3Ihc8jY0olMuYKsJ25+h3JYv\n6sehiF3EAkG+akvbQWBnJ3LMdZAxi7f3MqSNZ4LWaQKCAQAy+WeaWOKWNuMRVJpi\nSaje/B0hLNd7jBWWD5rnFuXtmuyWP9FI+05W8LWPgoPamoEiE90TqCPKkFjILBAE\n1QPujTFCgt/fj3DiGlW63M/CB4zjjSEinPbkXY5NNxI4bVoC4F/Fq4LCzRCbMJTX\n4R56cb/FBtJChysq9NWlWY2AJON9zIG8G/HmEwJUFZ0PaznWJffCxidYWwkUr40k\nMCeGmquybWnV1OeWibeZfsJDolMPsES3yISm4f9C9o7a5t83V6iCKyXBGOnLhqkF\n35CeqWmX3kYcYTPPZhWVvDEE/9u5e+vbC851LI/kKF/GU/UhCxe88pWm7npNb+Mk\nmPmpAoIBAHOEiErJtYuB4UmXMeXDDH9qRUFn94idkyStWZwtPYbxeaUFHi1IPNhp\nTZuhUtOW45OqH3A8EckVeJCS2nhd4pSiQ/zGsoi0SGY4sFmLKdkv6TVXj711wdny\nd54d0gAEGcMDESE6tTYi57kJ1TmciSNoJeQSCQKTqBMIPdUA0ov0hhK4/9KMFvuu\nuJdXm6p99MGMrhhYR3JtTEllVbyiWEeqsDiJ/zWAAgs0Pjy1TP8JqwUEXhCOAEWW\nuOCq9Ny9Eh3W7sB8P7rlhUK93+v7LS5AO0YfG4u7nOiSBypHdfbv7dYNRH11iZwY\n2co9X/dsPd1mASrfnIYsB+16J4cqLoECggEAD2IMNNW5SQCQgNa1XOdL6O9eXpRd\nXUuiDxwUOuLuPfAMCth4DyoZqR/B48rLsqzm3M+xl40DmEwH2HsRowt02iVACr1I\na1XUBq8GyAteiGTQ0h6Jda/iKyBwgSGunB4FQ8j8AUeosqWQDCUSFEE0wnSMaYiL\nYSWkwBj+im48cZpgjm+oRkTfTvWjmM82YWvahHASzcOKhTvGfW9fUxDiv8AbGkDX\nJ4YXntWorfIY+Me5Z1UjCnhK+Rj3JdPxQ4wfurjPHyVeRtvTNMQiDgaPa+W4RP8d\n8g8uLMhebHQBnzvmtyNlLBDV2rDFIZNUCcyGDb0qWAg52lOmu5hjIQ3y+A==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T07:25:37.180 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:38.230 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T07:25:38.555 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:38 smithi060 ceph-mon[31244]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:38.555 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:38 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:39.598 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T07:25:39.598 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial admin user... 2024-09-21T07:25:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:39 smithi060 ceph-mon[31244]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:39 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:41.060 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:40 smithi060 ceph-mon[31244]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:41.060 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:41.063 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$DY87Lbtpw5VQcfOAXum33uO3QHvCzHWsq.HnB.pM85ANQxqWPq6.y", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726903540, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T07:25:41.063 INFO:teuthology.orchestra.run.smithi060.stdout:Fetching dashboard port number... 2024-09-21T07:25:41.999 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:41 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3979413243' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T07:25:42.261 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T07:25:42.271 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:25:42.271 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-21T07:25:42.279 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:25:42.279 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-21T07:25:42.279 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-21T07:25:42.279 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T07:25:42.281 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph Dashboard is now available at: 2024-09-21T07:25:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: URL: https://smithi060.front.sepia.ceph.com:8443/ 2024-09-21T07:25:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: User: admin 2024-09-21T07:25:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: Password: rses1s77cv 2024-09-21T07:25:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:42.282 INFO:teuthology.orchestra.run.smithi060.stdout:Saving cluster configuration to /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config directory 2024-09-21T07:25:43.626 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: ceph telemetry on 2024-09-21T07:25:43.627 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.628 INFO:teuthology.orchestra.run.smithi060.stdout:For more information see: 2024-09-21T07:25:43.628 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.628 INFO:teuthology.orchestra.run.smithi060.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T07:25:43.628 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:43.628 INFO:teuthology.orchestra.run.smithi060.stdout:Bootstrap complete. 2024-09-21T07:25:43.667 INFO:tasks.cephadm:Fetching config... 2024-09-21T07:25:43.667 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:25:43.668 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T07:25:43.685 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T07:25:43.685 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:25:43.685 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T07:25:43.741 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T07:25:43.741 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:25:43.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T07:25:43.808 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T07:25:43.809 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:25:43.809 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T07:25:43.864 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T07:25:43.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:25:43.940 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:25:43.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:25:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:25:44.007 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:25:44.050 INFO:teuthology.orchestra.run.smithi187.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCieWH5sG/9vJsAmtqGN0/TlH0b/GAh3j6kmyzq7zA+w5NFqkkxd3peBPHcfi7egsdJO4a+Oo93odRZdXMi3q8ywuZXZGIbfNqVBtD3nrus9F6tTC8XQeb8Qy2HOmYHYRD+ZgsMiYssm1gz1SWSsMBPL3E+7o8YPbv/zIuEszK87TzIwyqdxqXo/B9poyUsFFr/GAU6VHnyN+42JRhxYQJJrHaSTRVHpqPeH35nlZmdvqAOibzORICbOddG6FGKzR1xXkjzLUbh9Ln4+vWO9WUKrU2sjVtwT05cXRV9UWJ9vekn/yz/nOxRGOZh5g7sztfOewpUck4Jqn96DyxfBcH3KVjJv1fNiICl1Aa3EBbvHVBN4OQwVoSVf1Py3VbR7+IkFxMyfbkE2lmVp7rY/DUFC/hs75pqhwYagD9mV9BcmMRzZM5QgbhqSvgBDnA+qt1zMWCeBDII/W+Wz5Qo6uaNw/UKyWKF8eYOmdwrRY/i8xaYFzlYqDUc6oRl0YcJmjE= ceph-679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:25:44.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T07:25:44.316 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:25:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:44 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2614543074' entity='client.admin' 2024-09-21T07:25:46.102 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T07:25:46.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T07:25:46.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:46 smithi060 ceph-mon[31244]: mgrmap e13: x(active, since 12s) 2024-09-21T07:25:46.276 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:46 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2318843029' entity='client.admin' 2024-09-21T07:25:46.543 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"} : dispatch 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:48.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:25:48.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:25:48.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:48.401 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi123 2024-09-21T07:25:48.401 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:25:48.401 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:25:48.421 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:25:48.421 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:25:48.479 INFO:tasks.cephadm:Adding host smithi123 to orchestrator... 2024-09-21T07:25:48.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch host add smithi123 2024-09-21T07:25:48.730 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:25:49.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:49 smithi060 ceph-mon[31244]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T07:25:49.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:49 smithi060 ceph-mon[31244]: Updating smithi060:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:25:49.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:49 smithi060 ceph-mon[31244]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:25:49.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:49 smithi060 ceph-mon[31244]: Updating smithi060:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:25:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:50 smithi060 ceph-mon[31244]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:51.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:51 smithi060 ceph-mon[31244]: Deploying cephadm binary to smithi123 2024-09-21T07:25:53.131 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi123' with addr '172.21.15.123' 2024-09-21T07:25:53.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:25:53.993 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:25:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:54 smithi060 ceph-mon[31244]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:25:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:54 smithi060 ceph-mon[31244]: Added host smithi123 2024-09-21T07:25:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:25:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:54.671 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:25:54.672 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}] 2024-09-21T07:25:55.393 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi187 2024-09-21T07:25:55.393 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:25:55.393 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:25:55.408 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:25:55.408 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:25:55.464 INFO:tasks.cephadm:Adding host smithi187 to orchestrator... 2024-09-21T07:25:55.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch host add smithi187 2024-09-21T07:25:55.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:55 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:55.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:55 smithi060 ceph-mon[31244]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:25:55.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:55 smithi060 ceph-mon[31244]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:25:55.718 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"} : dispatch 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:25:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:25:58.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T07:25:58.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: Updating smithi123:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:25:58.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:25:58.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:58.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:58.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:58 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:25:59.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:59 smithi060 ceph-mon[31244]: Updating smithi123:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:25:59.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:25:59 smithi060 ceph-mon[31244]: Deploying cephadm binary to smithi187 2024-09-21T07:26:00.127 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi187' with addr '172.21.15.187' 2024-09-21T07:26:00.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:00 smithi060 ceph-mon[31244]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:00.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:26:00.968 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:01.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:01.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:01 smithi060 ceph-mon[31244]: Added host smithi187 2024-09-21T07:26:01.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:01.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:01.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:01.610 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:26:01.610 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.187", "hostname": "smithi187", "labels": [], "status": ""}] 2024-09-21T07:26:02.226 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:02 smithi060 ceph-mon[31244]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:02.240 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:02.260 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T07:26:02.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T07:26:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:03.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:03 smithi060 ceph-mon[31244]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:26:04.132 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-09-21T07:26:04.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:04 smithi060 ceph-mon[31244]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:04.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:04 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/783988308' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:26:04.842 INFO:tasks.cephadm:Adding mon.a on smithi060 2024-09-21T07:26:04.843 INFO:tasks.cephadm:Adding mon.b on smithi123 2024-09-21T07:26:04.843 INFO:tasks.cephadm:Adding mon.c on smithi187 2024-09-21T07:26:04.843 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi060:172.21.15.60=a;smithi123:172.21.15.123=b;smithi187:172.21.15.187=c' 2024-09-21T07:26:05.091 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/783988308' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"} : dispatch 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:05.708 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mon update... 2024-09-21T07:26:06.317 DEBUG:teuthology.orchestra.run.smithi123:mon.b> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T07:26:06.320 DEBUG:teuthology.orchestra.run.smithi187:mon.c> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T07:26:06.323 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:26:06.323 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:26:06.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T07:26:06.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: Updating smithi187:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:06.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:06.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:26:06.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: Updating smithi187:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:26:06.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:06.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:06.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:06.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:06.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:06.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:06.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:06.953 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:07.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:07 smithi060 ceph-mon[31244]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi123:172.21.15.123=b;smithi187:172.21.15.187=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:26:07.420 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:07 smithi060 ceph-mon[31244]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi123:172.21.15.123=b;smithi187:172.21.15.187=c;count:3 2024-09-21T07:26:07.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:07 smithi060 ceph-mon[31244]: Deploying daemon mon.c on smithi187 2024-09-21T07:26:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:08 smithi060 ceph-mon[31244]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:08.704 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:26:08.704 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","modified":"2024-09-21T07:24:33.442014Z","created":"2024-09-21T07:24:33.442014Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:26:08.704 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2024-09-21T07:26:09.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:09 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/3960700149' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:10 smithi060 ceph-mon[31244]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:10.663 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:26:10.663 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:26:10.918 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:26:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:26:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: mon.a calling monitor election 2024-09-21T07:26:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: mon.c calling monitor election 2024-09-21T07:26:15.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:15.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:15.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:15.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:15.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:26:15.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: monmap epoch 2 2024-09-21T07:26:15.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: last_changed 2024-09-21T07:26:10.530434+0000 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: created 2024-09-21T07:24:33.442014+0000 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: min_mon_release 19 (squid) 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: election_strategy: 1 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.c 2024-09-21T07:26:15.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: fsmap 2024-09-21T07:26:15.876 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:26:15.876 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: mgrmap e13: x(active, since 43s) 2024-09-21T07:26:15.876 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: overall HEALTH_OK 2024-09-21T07:26:15.876 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:15.876 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:15.876 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:15.877 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:15.877 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:16.030 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:26:16.031 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":2,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","modified":"2024-09-21T07:26:10.530434Z","created":"2024-09-21T07:24:33.442014Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:26:16.031 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 2 2024-09-21T07:26:16.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:16 smithi060 ceph-mon[31244]: Deploying daemon mon.b on smithi123 2024-09-21T07:26:16.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:16 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/420768443' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:16.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:16 smithi187 ceph-mon[34367]: Deploying daemon mon.b on smithi123 2024-09-21T07:26:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:16 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/420768443' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:17.649 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:26:17.650 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:26:17.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:17 smithi060 ceph-mon[31244]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:17.872 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:26:17 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:26:17.530+0000 7fa27b509640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T07:26:17.902 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:26:18.011 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:17 smithi187 ceph-mon[34367]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:18.589 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:26:18.589 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":2,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","modified":"2024-09-21T07:26:10.530434Z","created":"2024-09-21T07:24:33.442014Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:26:18.589 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 2 2024-09-21T07:26:18.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:18 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/3707400214' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:19.013 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:18 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/3707400214' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:19 smithi123 systemd[1]: Started Ceph mon.b for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:26:20.162 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:26:20.162 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:26:20.431 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:26:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:26:24.729 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":3,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","modified":"2024-09-21T07:26:19.367039Z","created":"2024-09-21T07:24:33.442014Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T07:26:24.729 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 3 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: mon.a calling monitor election 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: mon.c calling monitor election 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: mon.b calling monitor election 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: monmap epoch 3 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: last_changed 2024-09-21T07:26:19.367039+0000 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: created 2024-09-21T07:24:33.442014+0000 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: min_mon_release 19 (squid) 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: election_strategy: 1 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.c 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: fsmap 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:26:24.731 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: mgrmap e13: x(active, since 51s) 2024-09-21T07:26:24.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: overall HEALTH_OK 2024-09-21T07:26:24.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: mon.a calling monitor election 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: mon.c calling monitor election 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:24.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: mon.b calling monitor election 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: monmap epoch 3 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: last_changed 2024-09-21T07:26:19.367039+0000 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: created 2024-09-21T07:24:33.442014+0000 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: min_mon_release 19 (squid) 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: election_strategy: 1 2024-09-21T07:26:24.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.c 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: fsmap 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: mgrmap e13: x(active, since 51s) 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: overall HEALTH_OK 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:26:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: mon.a calling monitor election 2024-09-21T07:26:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:26:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: mon.c calling monitor election 2024-09-21T07:26:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: mon.b calling monitor election 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: monmap epoch 3 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: last_changed 2024-09-21T07:26:19.367039+0000 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: created 2024-09-21T07:24:33.442014+0000 2024-09-21T07:26:24.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: min_mon_release 19 (squid) 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: election_strategy: 1 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: 1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.c 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: 2: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: fsmap 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: mgrmap e13: x(active, since 51s) 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: overall HEALTH_OK 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:24.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:25.299 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T07:26:25.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T07:26:25.558 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:25.558 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:25 smithi187 ceph-mon[34367]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:25.558 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:25 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/1752514076' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:25.558 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:25.558 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:25.558 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:25.569 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:25 smithi060 ceph-mon[31244]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:25 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/1752514076' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:25.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:25 smithi123 ceph-mon[34166]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:25 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/1752514076' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:26:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:26:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:26.466 INFO:teuthology.orchestra.run.smithi060.stdout:# minimal ceph.conf for 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:26:26.466 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-09-21T07:26:26.466 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:26:26.466 INFO:teuthology.orchestra.run.smithi060.stdout: mon_host = [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-21T07:26:27.093 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.093 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.093 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.093 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:27.093 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T07:26:27.093 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: Updating smithi060:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: Updating smithi123:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: Updating smithi187:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.094 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.095 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:26 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1878347769' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.096 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T07:26:27.096 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:26:27.097 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:26:27.124 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:26:27.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:26:27.190 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:26:27.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:26:27.218 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: Updating smithi060:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: Updating smithi123:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: Updating smithi187:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.219 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:27.220 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.221 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:26 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1878347769' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.222 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:26:27.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:26:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: Updating smithi123:/etc/ceph/ceph.conf 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: Updating smithi187:/etc/ceph/ceph.conf 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: Updating smithi060:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: Updating smithi123:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: Updating smithi187:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:26 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1878347769' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:27.288 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:26:27.288 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:26:27.317 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:26:27.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:26:27.385 INFO:tasks.cephadm:Adding mgr.x on smithi060 2024-09-21T07:26:27.385 INFO:tasks.cephadm:Adding mgr.y on smithi123 2024-09-21T07:26:27.386 INFO:tasks.cephadm:Adding mgr.z on smithi187 2024-09-21T07:26:27.386 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi060=x;smithi123=y;smithi187=z' 2024-09-21T07:26:27.666 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:26:28.054 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:27 smithi187 ceph-mon[34367]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:26:28.054 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:27 smithi187 ceph-mon[34367]: Reconfiguring daemon mon.a on smithi060 2024-09-21T07:26:28.055 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:27 smithi187 ceph-mon[34367]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:28.055 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:27 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:28.114 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:27 smithi060 ceph-mon[31244]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:26:28.115 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:27 smithi060 ceph-mon[31244]: Reconfiguring daemon mon.a on smithi060 2024-09-21T07:26:28.115 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:27 smithi060 ceph-mon[31244]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:28.115 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:27 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:28.275 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mgr update... 2024-09-21T07:26:28.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:27 smithi123 ceph-mon[34166]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:26:28.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:27 smithi123 ceph-mon[34166]: Reconfiguring daemon mon.a on smithi060 2024-09-21T07:26:28.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:27 smithi123 ceph-mon[34166]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:28.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:27 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:28.822 DEBUG:teuthology.orchestra.run.smithi123:mgr.y> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T07:26:28.825 DEBUG:teuthology.orchestra.run.smithi187:mgr.z> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T07:26:28.827 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T07:26:28.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T07:26:28.830 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T07:26:28.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T07:26:28.874 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T07:26:28.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T07:26:28.916 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:26:28.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T07:26:28.960 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:26:28.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T07:26:29.004 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T07:26:29.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T07:26:29.047 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:26:29.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T07:26:29.090 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T07:26:29.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T07:26:29.134 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T07:26:29.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T07:26:29.140 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:29.141 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T07:26:29.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T07:26:29.190 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T07:26:29.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T07:26:29.217 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:29.227 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T07:26:29.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T07:26:29.271 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T07:26:29.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T07:26:29.321 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:26:29.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T07:26:29.366 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:26:29.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: Reconfiguring daemon mon.b on smithi123 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi123=y;smithi187=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: Saving service mgr spec with placement smithi060=x;smithi123=y;smithi187=z;count:3 2024-09-21T07:26:29.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.386 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T07:26:29.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T07:26:29.439 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:26:29.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T07:26:29.495 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:26:29.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:26:29.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: Reconfiguring daemon mon.b on smithi123 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi123=y;smithi187=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: Saving service mgr spec with placement smithi060=x;smithi123=y;smithi187=z;count:3 2024-09-21T07:26:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: Reconfiguring daemon mon.b on smithi123 2024-09-21T07:26:29.522 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi123=y;smithi187=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:26:29.523 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: Saving service mgr spec with placement smithi060=x;smithi123=y;smithi187=z;count:3 2024-09-21T07:26:29.523 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:29.568 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:26:29.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:26:29.621 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:26:29.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T07:26:29.678 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T07:26:29.679 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T07:26:29.727 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T07:26:29.727 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T07:26:29.788 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T07:26:29.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T07:26:29.832 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:26:29.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:26:29.895 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:26:29.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T07:26:29.950 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:26:29.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T07:26:29.996 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T07:26:29.996 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi060') 2024-09-21T07:26:30.597 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:30 smithi187 ceph-mon[34367]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:30.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:30.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:30.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:30.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:30.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:30 smithi123 ceph-mon[34166]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:30 smithi060 ceph-mon[31244]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:30.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:30.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:26:30.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:26:30.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: Reconfiguring daemon mon.c on smithi187 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3257001582' entity='client.admin' 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='client.? ' entity='client.admin' 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.326 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:31.327 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:26:31.327 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:31.327 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: Reconfiguring daemon mon.c on smithi187 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3257001582' entity='client.admin' 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='client.? ' entity='client.admin' 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:31.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:26:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: Reconfiguring daemon mon.c on smithi187 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3257001582' entity='client.admin' 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='client.? ' entity='client.admin' 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:31.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:31.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:26:31.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:31.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:32.028 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi060') 2024-09-21T07:26:32.029 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi060') 2024-09-21T07:26:32.090 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.099 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.100 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.204 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.205 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.205 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.207 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.207 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.208 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.212 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.215 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.215 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.222 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.223 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.235 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.236 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.242 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.252 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:32.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:32 smithi060 ceph-mon[31244]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:32.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:32 smithi060 ceph-mon[31244]: Deploying daemon mgr.z on smithi187 2024-09-21T07:26:32.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:32 smithi187 ceph-mon[34367]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:32.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:32 smithi187 ceph-mon[34367]: Deploying daemon mgr.z on smithi187 2024-09-21T07:26:32.520 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 systemd[1]: Starting Ceph mgr.z for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:26:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:32 smithi123 ceph-mon[34166]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:32.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:32 smithi123 ceph-mon[34166]: Deploying daemon mgr.z on smithi187 2024-09-21T07:26:32.850 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 podman[35602]: 2024-09-21 07:26:32.467806931 +0000 UTC m=+0.015562801 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:26:32.850 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 podman[35602]: 2024-09-21 07:26:32.571737261 +0000 UTC m=+0.119493160 container create f0a4d785a51c22d4e07f69cc193467ad7530aca29e6efbfe6989e14569ddba05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T07:26:32.851 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 podman[35602]: 2024-09-21 07:26:32.774308637 +0000 UTC m=+0.322064477 container init f0a4d785a51c22d4e07f69cc193467ad7530aca29e6efbfe6989e14569ddba05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-z, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:26:32.851 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 podman[35602]: 2024-09-21 07:26:32.777166175 +0000 UTC m=+0.324922016 container start f0a4d785a51c22d4e07f69cc193467ad7530aca29e6efbfe6989e14569ddba05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-z, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:26:32.851 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 ceph-mgr[35621]: -- 172.21.15.187:0/770237200 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9d4bad0e0 con 0x55a9d9950000 2024-09-21T07:26:32.851 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 bash[35602]: f0a4d785a51c22d4e07f69cc193467ad7530aca29e6efbfe6989e14569ddba05 2024-09-21T07:26:33.269 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 07:26:32 smithi187 systemd[1]: Started Ceph mgr.z for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: Deploying daemon mgr.y on smithi123 2024-09-21T07:26:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:33 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2860479049' entity='client.admin' 2024-09-21T07:26:34.255 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:34.255 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: Deploying daemon mgr.y on smithi123 2024-09-21T07:26:34.256 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:33 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2860479049' entity='client.admin' 2024-09-21T07:26:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:26:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: Deploying daemon mgr.y on smithi123 2024-09-21T07:26:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:33 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2860479049' entity='client.admin' 2024-09-21T07:26:34.849 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:34 smithi123 systemd[1]: Starting Ceph mgr.y for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:26:35.163 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:34 smithi123 podman[34964]: 2024-09-21 07:26:34.814041565 +0000 UTC m=+0.015357453 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:26:35.163 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:34 smithi123 podman[34964]: 2024-09-21 07:26:34.931388145 +0000 UTC m=+0.132704032 container create 0194e1fe0d62bee5764f74f4c9cfd0a1c55182ff8cbdc0e9fb1cbf237980be60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T07:26:35.163 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:35 smithi123 podman[34964]: 2024-09-21 07:26:35.158730312 +0000 UTC m=+0.360046197 container init 0194e1fe0d62bee5764f74f4c9cfd0a1c55182ff8cbdc0e9fb1cbf237980be60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T07:26:35.163 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:35 smithi123 podman[34964]: 2024-09-21 07:26:35.162250377 +0000 UTC m=+0.363566270 container start 0194e1fe0d62bee5764f74f4c9cfd0a1c55182ff8cbdc0e9fb1cbf237980be60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T07:26:35.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:35 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2760174772' entity='client.admin' 2024-09-21T07:26:35.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:35 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/819952209' entity='client.admin' 2024-09-21T07:26:35.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:35 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2760174772' entity='client.admin' 2024-09-21T07:26:35.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:35 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/819952209' entity='client.admin' 2024-09-21T07:26:35.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:35 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2760174772' entity='client.admin' 2024-09-21T07:26:35.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:35 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/819952209' entity='client.admin' 2024-09-21T07:26:35.599 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:35 smithi123 ceph-mgr[34983]: -- 172.21.15.123:0/1335786182 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f121410e0 con 0x558f1215fa80 2024-09-21T07:26:35.599 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:35 smithi123 bash[34964]: 0194e1fe0d62bee5764f74f4c9cfd0a1c55182ff8cbdc0e9fb1cbf237980be60 2024-09-21T07:26:35.599 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 07:26:35 smithi123 systemd[1]: Started Ceph mgr.y for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:26:35.709 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1471281012' entity='client.admin' 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:36 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/66316412' entity='client.admin' 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1471281012' entity='client.admin' 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:36 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/66316412' entity='client.admin' 2024-09-21T07:26:36.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 -- 172.21.15.60:0/3218779999 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd84803fb20 msgr2=0x7fd848042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 --2- 172.21.15.60:0/3218779999 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd84803fb20 0x7fd848042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd854009c20 tx=0x7fd854005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 -- 172.21.15.60:0/3218779999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd860103770 msgr2=0x7fd860199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 --2- 172.21.15.60:0/3218779999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd860103770 0x7fd860199cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd85000e9f0 tx=0x7fd85000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 -- 172.21.15.60:0/3218779999 shutdown_connections 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 --2- 172.21.15.60:0/3218779999 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd84803fb20 0x7fd848042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 --2- 172.21.15.60:0/3218779999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8601051a0 0x7fd86019aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 --2- 172.21.15.60:0/3218779999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd860104800 0x7fd86019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 --2- 172.21.15.60:0/3218779999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd860103770 0x7fd860199cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 -- 172.21.15.60:0/3218779999 >> 172.21.15.60:0/3218779999 conn(0x7fd8600ff0c0 msgr2=0x7fd860107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 -- 172.21.15.60:0/3218779999 shutdown_connections 2024-09-21T07:26:36.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.637+0000 7fd864e06640 1 -- 172.21.15.60:0/3218779999 wait complete. 2024-09-21T07:26:36.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.759+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f8e401a2320 con 0x7f8e40104070 2024-09-21T07:26:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.765+0000 7f8e377fe640 1 -- 172.21.15.60:0/3781094890 <== mon.1 v2:172.21.15.187:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8e38054e50 con 0x7f8e40104070 2024-09-21T07:26:36.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.765+0000 7f8e377fe640 1 -- 172.21.15.60:0/3781094890 <== mon.1 v2:172.21.15.187:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f8e38016370 con 0x7f8e40104070 2024-09-21T07:26:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8e2c03fb20 msgr2=0x7f8e2c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 --2- 172.21.15.60:0/3781094890 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8e2c03fb20 0x7f8e2c042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e30000c00 tx=0x7f8e30005d50 comp rx=0 tx=0).stop 2024-09-21T07:26:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e40104070 msgr2=0x7f8e4019af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 --2- 172.21.15.60:0/3781094890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e40104070 0x7f8e4019af40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009fd0 tx=0x7f8e3800ef10 comp rx=0 tx=0).stop 2024-09-21T07:26:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 shutdown_connections 2024-09-21T07:26:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 --2- 172.21.15.60:0/3781094890 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8e2c03fb20 0x7f8e2c042030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 --2- 172.21.15.60:0/3781094890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e40104070 0x7f8e4019af40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 --2- 172.21.15.60:0/3781094890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e401036d0 0x7f8e4019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 --2- 172.21.15.60:0/3781094890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e40102640 0x7f8e40199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 >> 172.21.15.60:0/3781094890 conn(0x7f8e400fdfb0 msgr2=0x7f8e400ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 shutdown_connections 2024-09-21T07:26:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:36.767+0000 7f8e44b06640 1 -- 172.21.15.60:0/3781094890 wait complete. 2024-09-21T07:26:36.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:36.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1471281012' entity='client.admin' 2024-09-21T07:26:36.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:36.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:36.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:36 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/66316412' entity='client.admin' 2024-09-21T07:26:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 -- 172.21.15.60:0/2488267608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b481068d0 msgr2=0x7f8b48108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2488267608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b481068d0 0x7f8b48108d30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009900 tx=0x7f8b3c02a410 comp rx=0 tx=0).stop 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 -- 172.21.15.60:0/2488267608 shutdown_connections 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2488267608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b48109470 0x7f8b4810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2488267608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b481068d0 0x7f8b48108d30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2488267608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b4806b980 0x7f8b48106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 -- 172.21.15.60:0/2488267608 >> 172.21.15.60:0/2488267608 conn(0x7f8b480fdfb0 msgr2=0x7f8b48100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 -- 172.21.15.60:0/2488267608 shutdown_connections 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.043+0000 7f8b4d631640 1 -- 172.21.15.60:0/2488267608 wait complete. 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 Processor -- start 2024-09-21T07:26:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 -- start start 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 0x7f8b481039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b481068d0 0x7f8b48102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48109470 0x7f8b481027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4810f240 con 0x7f8b4806b980 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4810f0c0 con 0x7f8b48109470 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b4d631640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4810f3c0 con 0x7f8b481068d0 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.044+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 0x7f8b481039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 0x7f8b481039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59046/0 (socket says 172.21.15.60:59046) 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 -- 172.21.15.60:0/2705277477 learned_addr learned my addr 172.21.15.60:0/2705277477 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b467fc640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b481068d0 0x7f8b48102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b477fe640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48109470 0x7f8b481027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 -- 172.21.15.60:0/2705277477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b481068d0 msgr2=0x7f8b48102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b481068d0 0x7f8b48102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 -- 172.21.15.60:0/2705277477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48109470 msgr2=0x7f8b481027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48109470 0x7f8b481027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 -- 172.21.15.60:0/2705277477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b48102ed0 con 0x7f8b4806b980 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b467fc640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b481068d0 0x7f8b48102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b477fe640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48109470 0x7f8b481027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b46ffd640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 0x7f8b481039c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800e9f0 tx=0x7f8b3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800cd80 con 0x7f8b4806b980 2024-09-21T07:26:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b481a3f60 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b481a4350 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.045+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8b380108c0 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.046+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b380187d0 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.047+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f8b38018970 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.047+0000 7f8b2ffff640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b3003fb20 0x7f8b30042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.047+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b4810fa00 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.047+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8b380557b0 con 0x7f8b4806b980 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.047+0000 7f8b467fc640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b3003fb20 0x7f8b30042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.048+0000 7f8b467fc640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b3003fb20 0x7f8b30042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c000c00 tx=0x7f8b3c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.052+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8b380071c0 con 0x7f8b4806b980 2024-09-21T07:26:37.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.256+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f8b48106d20 con 0x7f8b4806b980 2024-09-21T07:26:37.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.259+0000 7f8b2ffff640 1 -- 172.21.15.60:0/2705277477 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f8b48106d20 con 0x7f8b4806b980 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b3003fb20 msgr2=0x7f8b30042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b3003fb20 0x7f8b30042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c000c00 tx=0x7f8b3c031400 comp rx=0 tx=0).stop 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 msgr2=0x7f8b481039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 0x7f8b481039c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800e9f0 tx=0x7f8b3800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 shutdown_connections 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b3003fb20 0x7f8b30042030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b48109470 0x7f8b481027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b481068d0 0x7f8b48102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 --2- 172.21.15.60:0/2705277477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4806b980 0x7f8b481039c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 >> 172.21.15.60:0/2705277477 conn(0x7f8b480fdfb0 msgr2=0x7f8b48104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 shutdown_connections 2024-09-21T07:26:37.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.262+0000 7f8b4d631640 1 -- 172.21.15.60:0/2705277477 wait complete. 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:37.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: Reconfiguring daemon mgr.x on smithi060 2024-09-21T07:26:37.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:37.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3218779999' entity='client.admin' 2024-09-21T07:26:37.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='client.? ' entity='client.admin' 2024-09-21T07:26:37.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:37 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2705277477' entity='client.admin' 2024-09-21T07:26:37.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: Reconfiguring daemon mgr.x on smithi060 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3218779999' entity='client.admin' 2024-09-21T07:26:37.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='client.? ' entity='client.admin' 2024-09-21T07:26:37.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:37 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2705277477' entity='client.admin' 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 -- 172.21.15.60:0/2620841349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 msgr2=0x7ff244103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/2620841349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff244103ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff234009900 tx=0x7ff23402a480 comp rx=0 tx=0).stop 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 -- 172.21.15.60:0/2620841349 shutdown_connections 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/2620841349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff244104070 0x7ff24410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/2620841349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff244103ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/2620841349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff244102640 0x7ff244102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 -- 172.21.15.60:0/2620841349 >> 172.21.15.60:0/2620841349 conn(0x7ff2440fdfb0 msgr2=0x7ff244100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 -- 172.21.15.60:0/2620841349 shutdown_connections 2024-09-21T07:26:37.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.815+0000 7ff24b3d0640 1 -- 172.21.15.60:0/2620841349 wait complete. 2024-09-21T07:26:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 Processor -- start 2024-09-21T07:26:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 -- start start 2024-09-21T07:26:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff244102640 0x7ff24406b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff24419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff244104070 0x7ff2441a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff24410e130 con 0x7ff2441036d0 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff24410dfb0 con 0x7ff244104070 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24b3d0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff24410e2b0 con 0x7ff244102640 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24896b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff24419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24896b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff24419ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59074/0 (socket says 172.21.15.60:59074) 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24896b640 1 -- 172.21.15.60:0/4055239300 learned_addr learned my addr 172.21.15.60:0/4055239300 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24916c640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff244102640 0x7ff24406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.816+0000 7ff24996d640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff244104070 0x7ff2441a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24896b640 1 -- 172.21.15.60:0/4055239300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff244102640 msgr2=0x7ff24406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24896b640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff244102640 0x7ff24406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24896b640 1 -- 172.21.15.60:0/4055239300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff244104070 msgr2=0x7ff2441a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24896b640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff244104070 0x7ff2441a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24896b640 1 -- 172.21.15.60:0/4055239300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2441a1980 con 0x7ff2441036d0 2024-09-21T07:26:37.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24896b640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff24419ebd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff234005790 tx=0x7ff2340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23403f030 con 0x7ff2441036d0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff234003c90 con 0x7ff2441036d0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2441a1c10 con 0x7ff2441036d0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234035070 con 0x7ff2441036d0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.817+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2441a20f0 con 0x7ff2441036d0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.818+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7ff234042030 con 0x7ff2441036d0 2024-09-21T07:26:37.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.818+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff244102ab0 con 0x7ff2441036d0 2024-09-21T07:26:37.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.818+0000 7ff23a7fc640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff23003fb20 0x7ff230042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:37.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.819+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff234074af0 con 0x7ff2441036d0 2024-09-21T07:26:37.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.819+0000 7ff24916c640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff23003fb20 0x7ff230042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:37.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.819+0000 7ff24916c640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff23003fb20 0x7ff230042030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff240009bd0 tx=0x7ff240005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:37.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:37.823+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff234036df0 con 0x7ff2441036d0 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:37.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: Reconfiguring daemon mgr.x on smithi060 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3218779999' entity='client.admin' 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='client.? ' entity='client.admin' 2024-09-21T07:26:37.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:37 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2705277477' entity='client.admin' 2024-09-21T07:26:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.012+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ff244063fc0 con 0x7ff2441036d0 2024-09-21T07:26:38.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.015+0000 7ff23a7fc640 1 -- 172.21.15.60:0/4055239300 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7ff23403ae70 con 0x7ff2441036d0 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff23003fb20 msgr2=0x7ff230042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff23003fb20 0x7ff230042030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff240009bd0 tx=0x7ff240005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 msgr2=0x7ff24419ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff24419ebd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff234005790 tx=0x7ff2340042f0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 shutdown_connections 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff23003fb20 0x7ff230042030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff244104070 0x7ff2441a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2441036d0 0x7ff24419ebd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 --2- 172.21.15.60:0/4055239300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff244102640 0x7ff24406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 >> 172.21.15.60:0/4055239300 conn(0x7ff2440fdfb0 msgr2=0x7ff2441069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 shutdown_connections 2024-09-21T07:26:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:38.018+0000 7ff24b3d0640 1 -- 172.21.15.60:0/4055239300 wait complete. 2024-09-21T07:26:38.559 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: Standby manager daemon z started 2024-09-21T07:26:38.559 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:26:38.559 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:26:38.559 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:26:38.559 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:26:38.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:38.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:38 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4055239300' entity='client.admin' 2024-09-21T07:26:38.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: Standby manager daemon z started 2024-09-21T07:26:38.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:26:38.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:26:38.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:26:38.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:26:38.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:38.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:38 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4055239300' entity='client.admin' 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: Standby manager daemon z started 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.187:0/1969231620' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:38.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:38 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4055239300' entity='client.admin' 2024-09-21T07:26:39.711 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:39 smithi060 ceph-mon[31244]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-21T07:26:39.711 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:39 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:26:39.711 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:39 smithi060 ceph-mon[31244]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:39.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:39 smithi187 ceph-mon[34367]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-21T07:26:39.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:39 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:26:39.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:39 smithi187 ceph-mon[34367]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:39.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:39 smithi123 ceph-mon[34166]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-21T07:26:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:39 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:26:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:39 smithi123 ceph-mon[34166]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:39.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 -- 172.21.15.60:0/3006193954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d4105180 msgr2=0x7f60d410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 --2- 172.21.15.60:0/3006193954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d4105180 0x7f60d410bb20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f60cc009ca0 tx=0x7f60cc02a950 comp rx=0 tx=0).stop 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 -- 172.21.15.60:0/3006193954 shutdown_connections 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 --2- 172.21.15.60:0/3006193954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d4105180 0x7f60d410bb20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 --2- 172.21.15.60:0/3006193954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60d41047e0 0x7f60d4104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 --2- 172.21.15.60:0/3006193954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 0x7f60d4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.890+0000 7f60da4b8640 1 -- 172.21.15.60:0/3006193954 >> 172.21.15.60:0/3006193954 conn(0x7f60d40ff0c0 msgr2=0x7f60d4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.891+0000 7f60da4b8640 1 -- 172.21.15.60:0/3006193954 shutdown_connections 2024-09-21T07:26:39.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.891+0000 7f60da4b8640 1 -- 172.21.15.60:0/3006193954 wait complete. 2024-09-21T07:26:39.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.891+0000 7f60da4b8640 1 Processor -- start 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.891+0000 7f60da4b8640 1 -- start start 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60da4b8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 0x7f60d4199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60da4b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 0x7f60d419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60da4b8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60d4105180 0x7f60d419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60da4b8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f60d410f2b0 con 0x7f60d41047e0 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60da4b8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f60d410f130 con 0x7f60d4103750 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60da4b8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f60d410f430 con 0x7f60d4105180 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 0x7f60d419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 0x7f60d4199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 0x7f60d419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59094/0 (socket says 172.21.15.60:59094) 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 -- 172.21.15.60:0/2722371818 learned_addr learned my addr 172.21.15.60:0/2722371818 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:39.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d8a55640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60d4105180 0x7f60d419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 -- 172.21.15.60:0/2722371818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60d4105180 msgr2=0x7f60d419b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60d4105180 0x7f60d419b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 -- 172.21.15.60:0/2722371818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 msgr2=0x7f60d4199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 0x7f60d4199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 -- 172.21.15.60:0/2722371818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d419b8e0 con 0x7f60d41047e0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d3fff640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 0x7f60d4199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.892+0000 7f60d37fe640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 0x7f60d419a520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f60c800d770 tx=0x7f60c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.893+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8017070 con 0x7f60d41047e0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.893+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f60c80054b0 con 0x7f60d41047e0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.893+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8004c70 con 0x7f60d41047e0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.893+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d419bbd0 con 0x7f60d41047e0 2024-09-21T07:26:39.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.893+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d41a22d0 con 0x7f60d41047e0 2024-09-21T07:26:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.894+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d4103bc0 con 0x7f60d41047e0 2024-09-21T07:26:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.895+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f60c8004e10 con 0x7f60d41047e0 2024-09-21T07:26:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.895+0000 7f60d17fa640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f60bc07afd0 0x7f60bc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.896+0000 7f60d3fff640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f60bc07afd0 0x7f60bc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.896+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f60c809c710 con 0x7f60d41047e0 2024-09-21T07:26:39.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.896+0000 7f60d3fff640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f60bc07afd0 0x7f60bc07d4e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009fc0 tx=0x7f60c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:39.900+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60c80691f0 con 0x7f60d41047e0 2024-09-21T07:26:40.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.094+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f60d4063fc0 con 0x7f60d41047e0 2024-09-21T07:26:40.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.098+0000 7f60d17fa640 1 -- 172.21.15.60:0/2722371818 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v21)=0 v21) ==== 116+0+0 (secure 0 0 0) 0x7f60c806e0a0 con 0x7f60d41047e0 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f60bc07afd0 msgr2=0x7f60bc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f60bc07afd0 0x7f60bc07d4e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009fc0 tx=0x7f60c4005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 msgr2=0x7f60d419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 0x7f60d419a520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f60c800d770 tx=0x7f60c800dc30 comp rx=0 tx=0).stop 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 shutdown_connections 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f60bc07afd0 0x7f60bc07d4e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60d4105180 0x7f60d419b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60d41047e0 0x7f60d419a520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 --2- 172.21.15.60:0/2722371818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60d4103750 0x7f60d4199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 >> 172.21.15.60:0/2722371818 conn(0x7f60d40ff0c0 msgr2=0x7f60d4107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:40.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 shutdown_connections 2024-09-21T07:26:40.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.101+0000 7f60da4b8640 1 -- 172.21.15.60:0/2722371818 wait complete. 2024-09-21T07:26:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 -- 172.21.15.60:0/2615506972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70106bb0 msgr2=0x7f3b70108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2615506972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70106bb0 0x7f3b70108fd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009900 tx=0x7f3b6002a410 comp rx=0 tx=0).stop 2024-09-21T07:26:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 -- 172.21.15.60:0/2615506972 shutdown_connections 2024-09-21T07:26:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2615506972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b70109510 0x7f3b7010b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2615506972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70106bb0 0x7f3b70108fd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2615506972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 0x7f3b70101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 -- 172.21.15.60:0/2615506972 >> 172.21.15.60:0/2615506972 conn(0x7f3b700fd740 msgr2=0x7f3b700ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 -- 172.21.15.60:0/2615506972 shutdown_connections 2024-09-21T07:26:40.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.283+0000 7f3b772f7640 1 -- 172.21.15.60:0/2615506972 wait complete. 2024-09-21T07:26:40.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 Processor -- start 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 -- start start 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 0x7f3b7019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b70106bb0 0x7f3b7019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 0x7f3b7019d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7010f240 con 0x7f3b70109510 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7010f0c0 con 0x7f3b70106bb0 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b772f7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7010f3c0 con 0x7f3b70101b10 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b75894640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 0x7f3b7019d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b74892640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b70106bb0 0x7f3b7019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b75894640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 0x7f3b7019d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59116/0 (socket says 172.21.15.60:59116) 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.284+0000 7f3b75894640 1 -- 172.21.15.60:0/2082537746 learned_addr learned my addr 172.21.15.60:0/2082537746 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:40.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75093640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 0x7f3b7019c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75894640 1 -- 172.21.15.60:0/2082537746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 msgr2=0x7f3b7019c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75894640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 0x7f3b7019c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75894640 1 -- 172.21.15.60:0/2082537746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b70106bb0 msgr2=0x7f3b7019c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75894640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b70106bb0 0x7f3b7019c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75894640 1 -- 172.21.15.60:0/2082537746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7019daf0 con 0x7f3b70109510 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75093640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 0x7f3b7019c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b75894640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 0x7f3b7019d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800eb10 tx=0x7f3b6800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68004b20 con 0x7f3b70109510 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3b68004cc0 con 0x7f3b70109510 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7019dde0 con 0x7f3b70109510 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68010690 con 0x7f3b70109510 2024-09-21T07:26:40.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.285+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b701a4570 con 0x7f3b70109510 2024-09-21T07:26:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.286+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70101f20 con 0x7f3b70109510 2024-09-21T07:26:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.287+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f3b68005020 con 0x7f3b70109510 2024-09-21T07:26:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.288+0000 7f3b667fc640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3b5c07afd0 0x7f3b5c07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.288+0000 7f3b75093640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3b5c07afd0 0x7f3b5c07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.288+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3b6809d300 con 0x7f3b70109510 2024-09-21T07:26:40.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.288+0000 7f3b75093640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3b5c07afd0 0x7f3b5c07d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00baa0 tx=0x7f3b6c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:40.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.293+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b68065a00 con 0x7f3b70109510 2024-09-21T07:26:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 -- 172.21.15.60:0/3271055914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21241068d0 msgr2=0x7f2124108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 --2- 172.21.15.60:0/3271055914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21241068d0 0x7f2124108d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2110009900 tx=0x7f211002a410 comp rx=0 tx=0).stop 2024-09-21T07:26:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 -- 172.21.15.60:0/3271055914 shutdown_connections 2024-09-21T07:26:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 --2- 172.21.15.60:0/3271055914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2124109470 0x7f212410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 --2- 172.21.15.60:0/3271055914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21241068d0 0x7f2124108d30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 --2- 172.21.15.60:0/3271055914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f212406b980 0x7f2124106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 -- 172.21.15.60:0/3271055914 >> 172.21.15.60:0/3271055914 conn(0x7f21240fdfb0 msgr2=0x7f2124100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 -- 172.21.15.60:0/3271055914 shutdown_connections 2024-09-21T07:26:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.460+0000 7f212aaad640 1 -- 172.21.15.60:0/3271055914 wait complete. 2024-09-21T07:26:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 Processor -- start 2024-09-21T07:26:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 -- start start 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f212406b980 0x7f2124199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21241068d0 0x7f212419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 0x7f212419b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212904a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 0x7f212419b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212904a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 0x7f212419b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59144/0 (socket says 172.21.15.60:59144) 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212904a640 1 -- 172.21.15.60:0/3182268119 learned_addr learned my addr 172.21.15.60:0/3182268119 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f212410f240 con 0x7f2124109470 2024-09-21T07:26:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f212410f0c0 con 0x7f21241068d0 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f212410f3c0 con 0x7f212406b980 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.461+0000 7f2128849640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f212406b980 0x7f2124199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212904a640 1 -- 172.21.15.60:0/3182268119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f212406b980 msgr2=0x7f2124199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212904a640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f212406b980 0x7f2124199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212904a640 1 -- 172.21.15.60:0/3182268119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21241068d0 msgr2=0x7f212419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212904a640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21241068d0 0x7f212419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212904a640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212419b900 con 0x7f2124109470 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212904a640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 0x7f212419b0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f211c00eaa0 tx=0x7f211c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c00cdb0 con 0x7f2124109470 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f211c005020 con 0x7f2124109470 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f212419bbf0 con 0x7f2124109470 2024-09-21T07:26:40.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.462+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0116d0 con 0x7f2124109470 2024-09-21T07:26:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.463+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21241a22f0 con 0x7f2124109470 2024-09-21T07:26:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.464+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2124106d20 con 0x7f2124109470 2024-09-21T07:26:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.464+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f211c004a40 con 0x7f2124109470 2024-09-21T07:26:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.465+0000 7f2121ffb640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f211407afd0 0x7f211407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.465+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f211c09cea0 con 0x7f2124109470 2024-09-21T07:26:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.465+0000 7f2128849640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f211407afd0 0x7f211407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.466+0000 7f2128849640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f211407afd0 0x7f211407d4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21180095f0 tx=0x7f2118005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:40.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.470+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f211c016030 con 0x7f2124109470 2024-09-21T07:26:40.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.485+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f3b701a4a60 con 0x7f3b70109510 2024-09-21T07:26:40.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.489+0000 7f3b667fc640 1 -- 172.21.15.60:0/2082537746 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v22)=0 v22) ==== 111+0+0 (secure 0 0 0) 0x7f3b68069de0 con 0x7f3b70109510 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3b5c07afd0 msgr2=0x7f3b5c07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3b5c07afd0 0x7f3b5c07d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00baa0 tx=0x7f3b6c005d90 comp rx=0 tx=0).stop 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 msgr2=0x7f3b7019d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 0x7f3b7019d360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800eb10 tx=0x7f3b6800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 shutdown_connections 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3b5c07afd0 0x7f3b5c07d4e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b70109510 0x7f3b7019d360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b70106bb0 0x7f3b7019c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 --2- 172.21.15.60:0/2082537746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70101b10 0x7f3b7019c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 >> 172.21.15.60:0/2082537746 conn(0x7f3b700fd740 msgr2=0x7f3b70103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 shutdown_connections 2024-09-21T07:26:40.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.492+0000 7f3b772f7640 1 -- 172.21.15.60:0/2082537746 wait complete. 2024-09-21T07:26:40.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.670+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f2124063fc0 con 0x7f2124109470 2024-09-21T07:26:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.674+0000 7f2121ffb640 1 -- 172.21.15.60:0/3182268119 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7f211c0655a0 con 0x7f2124109470 2024-09-21T07:26:40.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.676+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f211407afd0 msgr2=0x7f211407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.676+0000 7f212aaad640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f211407afd0 0x7f211407d4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f21180095f0 tx=0x7f2118005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 msgr2=0x7f212419b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 0x7f212419b0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f211c00eaa0 tx=0x7f211c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 shutdown_connections 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f211407afd0 0x7f211407d4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2124109470 0x7f212419b0e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21241068d0 0x7f212419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 --2- 172.21.15.60:0/3182268119 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f212406b980 0x7f2124199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 >> 172.21.15.60:0/3182268119 conn(0x7f21240fdfb0 msgr2=0x7f2124104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 shutdown_connections 2024-09-21T07:26:40.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:40.677+0000 7f212aaad640 1 -- 172.21.15.60:0/3182268119 wait complete. 2024-09-21T07:26:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 -- 172.21.15.60:0/1435420856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c06b900 msgr2=0x7f370c106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 --2- 172.21.15.60:0/1435420856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c06b900 0x7f370c106410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009900 tx=0x7f36fc02a410 comp rx=0 tx=0).stop 2024-09-21T07:26:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 -- 172.21.15.60:0/1435420856 shutdown_connections 2024-09-21T07:26:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 --2- 172.21.15.60:0/1435420856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370c109490 0x7f370c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 --2- 172.21.15.60:0/1435420856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c106950 0x7f370c108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 --2- 172.21.15.60:0/1435420856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c06b900 0x7f370c106410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 -- 172.21.15.60:0/1435420856 >> 172.21.15.60:0/1435420856 conn(0x7f370c0fdfb0 msgr2=0x7f370c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 -- 172.21.15.60:0/1435420856 shutdown_connections 2024-09-21T07:26:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.169+0000 7f3713096640 1 -- 172.21.15.60:0/1435420856 wait complete. 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2722371818' entity='client.admin' 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: Standby manager daemon y started 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2082537746' entity='client.admin' 2024-09-21T07:26:41.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:41 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3182268119' entity='client.admin' 2024-09-21T07:26:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 Processor -- start 2024-09-21T07:26:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 -- start start 2024-09-21T07:26:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c06b900 0x7f370c19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370c106950 0x7f370c19c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 0x7f370c19d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f370c10f290 con 0x7f370c109490 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f370c10f110 con 0x7f370c06b900 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3713096640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f370c10f410 con 0x7f370c106950 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3711633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 0x7f370c19d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3711633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 0x7f370c19d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59156/0 (socket says 172.21.15.60:59156) 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3711633640 1 -- 172.21.15.60:0/1872905859 learned_addr learned my addr 172.21.15.60:0/1872905859 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f3710e32640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c06b900 0x7f370c19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.170+0000 7f370bfff640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370c106950 0x7f370c19c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3711633640 1 -- 172.21.15.60:0/1872905859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370c106950 msgr2=0x7f370c19c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3711633640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370c106950 0x7f370c19c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3711633640 1 -- 172.21.15.60:0/1872905859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c06b900 msgr2=0x7f370c19c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3711633640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c06b900 0x7f370c19c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3711633640 1 -- 172.21.15.60:0/1872905859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c19db70 con 0x7f370c109490 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3711633640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 0x7f370c19d350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f370400b970 tx=0x7f370400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704019070 con 0x7f370c109490 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c19de60 con 0x7f370c109490 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3704014440 con 0x7f370c109490 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040075d0 con 0x7f370c109490 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.171+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c1a4560 con 0x7f370c109490 2024-09-21T07:26:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.172+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370c106d60 con 0x7f370c109490 2024-09-21T07:26:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.174+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f370401c070 con 0x7f370c109490 2024-09-21T07:26:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.175+0000 7f3709ffb640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36f80b6480 0x7f36f80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.175+0000 7f3710e32640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36f80b6480 0x7f36f80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.175+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f37040e5080 con 0x7f370c109490 2024-09-21T07:26:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.175+0000 7f3710e32640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36f80b6480 0x7f36f80b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36fc031440 tx=0x7f36fc009630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.178+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37040ad540 con 0x7f370c109490 2024-09-21T07:26:41.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.368+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f370c1a48b0 con 0x7f370c109490 2024-09-21T07:26:41.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.372+0000 7f3709ffb640 1 -- 172.21.15.60:0/1872905859 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7f37040b1920 con 0x7f370c109490 2024-09-21T07:26:41.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36f80b6480 msgr2=0x7f36f80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:41.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36f80b6480 0x7f36f80b8990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f36fc031440 tx=0x7f36fc009630 comp rx=0 tx=0).stop 2024-09-21T07:26:41.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 msgr2=0x7f370c19d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:41.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 0x7f370c19d350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f370400b970 tx=0x7f370400be30 comp rx=0 tx=0).stop 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 shutdown_connections 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36f80b6480 0x7f36f80b8990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.374+0000 7f3713096640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370c109490 0x7f370c19d350 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.375+0000 7f3713096640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370c106950 0x7f370c19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.375+0000 7f3713096640 1 --2- 172.21.15.60:0/1872905859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f370c06b900 0x7f370c19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.375+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 >> 172.21.15.60:0/1872905859 conn(0x7f370c0fdfb0 msgr2=0x7f370c1003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.375+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 shutdown_connections 2024-09-21T07:26:41.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:41.375+0000 7f3713096640 1 -- 172.21.15.60:0/1872905859 wait complete. 2024-09-21T07:26:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2722371818' entity='client.admin' 2024-09-21T07:26:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: Standby manager daemon y started 2024-09-21T07:26:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:26:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:26:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:26:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:26:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2082537746' entity='client.admin' 2024-09-21T07:26:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:41 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3182268119' entity='client.admin' 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2722371818' entity='client.admin' 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: Standby manager daemon y started 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='mgr.? 172.21.15.123:0/3984245274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2082537746' entity='client.admin' 2024-09-21T07:26:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:41 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3182268119' entity='client.admin' 2024-09-21T07:26:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:42 smithi060 ceph-mon[31244]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:42.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:42 smithi060 ceph-mon[31244]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-21T07:26:42.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:26:42.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:42 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1872905859' entity='client.admin' 2024-09-21T07:26:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:42 smithi187 ceph-mon[34367]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:42.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:42 smithi187 ceph-mon[34367]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-21T07:26:42.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:26:42.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:42 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1872905859' entity='client.admin' 2024-09-21T07:26:42.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:42 smithi123 ceph-mon[34166]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:42.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:42 smithi123 ceph-mon[34166]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-21T07:26:42.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:26:42.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:42 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1872905859' entity='client.admin' 2024-09-21T07:26:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 -- 172.21.15.60:0/3937695470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 msgr2=0x7f2a0810dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 --2- 172.21.15.60:0/3937695470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0810dbd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009ca0 tx=0x7f2a0002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 -- 172.21.15.60:0/3937695470 shutdown_connections 2024-09-21T07:26:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 --2- 172.21.15.60:0/3937695470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0810dbd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 --2- 172.21.15.60:0/3937695470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a08108d10 0x7f2a0810b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 --2- 172.21.15.60:0/3937695470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 0x7f2a081087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 -- 172.21.15.60:0/3937695470 >> 172.21.15.60:0/3937695470 conn(0x7f2a080fdff0 msgr2=0x7f2a081004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 -- 172.21.15.60:0/3937695470 shutdown_connections 2024-09-21T07:26:43.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.002+0000 7f2a1024d640 1 -- 172.21.15.60:0/3937695470 wait complete. 2024-09-21T07:26:43.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 Processor -- start 2024-09-21T07:26:43.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 -- start start 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 0x7f2a0819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a08108d10 0x7f2a0819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08111470 con 0x7f2a0810b6c0 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081112f0 con 0x7f2a0806c4d0 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a1024d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081115f0 con 0x7f2a08108d10 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a0e7ea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a0e7ea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0819d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59168/0 (socket says 172.21.15.60:59168) 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a0e7ea640 1 -- 172.21.15.60:0/2251543904 learned_addr learned my addr 172.21.15.60:0/2251543904 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.003+0000 7f2a0dfe9640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 0x7f2a0819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0d7e8640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a08108d10 0x7f2a0819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0e7ea640 1 -- 172.21.15.60:0/2251543904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a08108d10 msgr2=0x7f2a0819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0e7ea640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a08108d10 0x7f2a0819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0e7ea640 1 -- 172.21.15.60:0/2251543904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 msgr2=0x7f2a0819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0e7ea640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 0x7f2a0819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0e7ea640 1 -- 172.21.15.60:0/2251543904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0819daa0 con 0x7f2a0810b6c0 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0dfe9640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 0x7f2a0819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a0e7ea640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0819d280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a00006010 tx=0x7f2a000307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00030be0 con 0x7f2a0810b6c0 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2a00031e00 con 0x7f2a0810b6c0 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0819dd30 con 0x7f2a0810b6c0 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a000046e0 con 0x7f2a0810b6c0 2024-09-21T07:26:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.004+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a081a4490 con 0x7f2a0810b6c0 2024-09-21T07:26:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.005+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a081087d0 con 0x7f2a0810b6c0 2024-09-21T07:26:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.007+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2a00004b40 con 0x7f2a0810b6c0 2024-09-21T07:26:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.008+0000 7f29feffd640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f29f40b6500 0x7f29f40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.008+0000 7f2a0dfe9640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f29f40b6500 0x7f29f40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.008+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2a00106830 con 0x7f2a0810b6c0 2024-09-21T07:26:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.008+0000 7f2a0dfe9640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f29f40b6500 0x7f29f40b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009fc0 tx=0x7f2a04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.011+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a000cecf0 con 0x7f2a0810b6c0 2024-09-21T07:26:43.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.201+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f2a0802e640 con 0x7f2a0810b6c0 2024-09-21T07:26:43.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.202+0000 7f29feffd640 1 -- 172.21.15.60:0/2251543904 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7f2a000d30d0 con 0x7f2a0810b6c0 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f29f40b6500 msgr2=0x7f29f40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f29f40b6500 0x7f29f40b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009fc0 tx=0x7f2a04005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 msgr2=0x7f2a0819d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0819d280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a00006010 tx=0x7f2a000307f0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 shutdown_connections 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f29f40b6500 0x7f29f40b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a0810b6c0 0x7f2a0819d280 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a08108d10 0x7f2a0819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 --2- 172.21.15.60:0/2251543904 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a0806c4d0 0x7f2a0819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:43.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 >> 172.21.15.60:0/2251543904 conn(0x7f2a080fdff0 msgr2=0x7f2a08109b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:43.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 shutdown_connections 2024-09-21T07:26:43.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:43.204+0000 7f2a1024d640 1 -- 172.21.15.60:0/2251543904 wait complete. 2024-09-21T07:26:44.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:44 smithi060 ceph-mon[31244]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:44 smithi187 ceph-mon[34367]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:44.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:44 smithi123 ceph-mon[34166]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 -- 172.21.15.60:0/2385648121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0102640 msgr2=0x7fd4a0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/2385648121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0102640 0x7fd4a0102ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd490009900 tx=0x7fd49002a480 comp rx=0 tx=0).stop 2024-09-21T07:26:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 -- 172.21.15.60:0/2385648121 shutdown_connections 2024-09-21T07:26:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/2385648121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4a0104070 0x7fd4a010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/2385648121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a01036d0 0x7fd4a0103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/2385648121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a0102640 0x7fd4a0102ab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 -- 172.21.15.60:0/2385648121 >> 172.21.15.60:0/2385648121 conn(0x7fd4a00fdfb0 msgr2=0x7fd4a0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 -- 172.21.15.60:0/2385648121 shutdown_connections 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 -- 172.21.15.60:0/2385648121 wait complete. 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.311+0000 7fd4a61d7640 1 Processor -- start 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 -- start start 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4a0102640 0x7fd4a0106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 0x7fd4a0104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a0104070 0x7fd4a0105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a010e140 con 0x7fd4a01036d0 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a010dfc0 con 0x7fd4a0104070 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd4a61d7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a010e2c0 con 0x7fd4a0102640 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 0x7fd4a0104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 0x7fd4a0104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59202/0 (socket says 172.21.15.60:59202) 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 -- 172.21.15.60:0/1194274491 learned_addr learned my addr 172.21.15.60:0/1194274491 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49f7fe640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4a0102640 0x7fd4a0106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49ffff640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a0104070 0x7fd4a0105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 -- 172.21.15.60:0/1194274491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4a0102640 msgr2=0x7fd4a0106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4a0102640 0x7fd4a0106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 -- 172.21.15.60:0/1194274491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a0104070 msgr2=0x7fd4a0105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a0104070 0x7fd4a0105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49effd640 1 -- 172.21.15.60:0/1194274491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a0105740 con 0x7fd4a01036d0 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.312+0000 7fd49ffff640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a0104070 0x7fd4a0105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.313+0000 7fd49effd640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 0x7fd4a0104b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd49400e9f0 tx=0x7fd49400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.313+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49400cd80 con 0x7fd4a01036d0 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.313+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd4940108c0 con 0x7fd4a01036d0 2024-09-21T07:26:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.313+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a01a3f50 con 0x7fd4a01036d0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.313+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4940187d0 con 0x7fd4a01036d0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.313+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a01a42f0 con 0x7fd4a01036d0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.314+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a010e900 con 0x7fd4a01036d0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.317+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd494010430 con 0x7fd4a01036d0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.317+0000 7fd49cff9640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd4880b6480 0x7fd4880b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.318+0000 7fd49f7fe640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd4880b6480 0x7fd4880b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.318+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd4940e5ec0 con 0x7fd4a01036d0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.318+0000 7fd49f7fe640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd4880b6480 0x7fd4880b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd490000c00 tx=0x7fd490031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.321+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4940ae420 con 0x7fd4a01036d0 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 -- 172.21.15.60:0/427157604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57201036d0 msgr2=0x7f5720103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 --2- 172.21.15.60:0/427157604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57201036d0 0x7f5720103ae0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5714009900 tx=0x7f571402a480 comp rx=0 tx=0).stop 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 -- 172.21.15.60:0/427157604 shutdown_connections 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 --2- 172.21.15.60:0/427157604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720104070 0x7f572010aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 --2- 172.21.15.60:0/427157604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57201036d0 0x7f5720103ae0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 --2- 172.21.15.60:0/427157604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5720102640 0x7f5720102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 -- 172.21.15.60:0/427157604 >> 172.21.15.60:0/427157604 conn(0x7f57200fdfb0 msgr2=0x7f5720100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 -- 172.21.15.60:0/427157604 shutdown_connections 2024-09-21T07:26:45.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.513+0000 7f57278bd640 1 -- 172.21.15.60:0/427157604 wait complete. 2024-09-21T07:26:45.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 Processor -- start 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 -- start start 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 0x7f572006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57201036d0 0x7f572019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720104070 0x7f57201a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f572010e150 con 0x7f5720102640 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f572010dfd0 con 0x7f57201036d0 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f57278bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f572010e2d0 con 0x7f5720104070 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f5725659640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 0x7f572006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f5725659640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 0x7f572006b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59216/0 (socket says 172.21.15.60:59216) 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f5725659640 1 -- 172.21.15.60:0/1571233152 learned_addr learned my addr 172.21.15.60:0/1571233152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.514+0000 7f5724e58640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57201036d0 0x7f572019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725e5a640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720104070 0x7f57201a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725659640 1 -- 172.21.15.60:0/1571233152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720104070 msgr2=0x7f57201a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725659640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720104070 0x7f57201a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725659640 1 -- 172.21.15.60:0/1571233152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57201036d0 msgr2=0x7f572019ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725659640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57201036d0 0x7f572019ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725659640 1 -- 172.21.15.60:0/1571233152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57201a1980 con 0x7f5720102640 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5724e58640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57201036d0 0x7f572019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f5725659640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 0x7f572006b6a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f571800db80 tx=0x7f571800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718017070 con 0x7f5720102640 2024-09-21T07:26:45.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5718004020 con 0x7f5720102640 2024-09-21T07:26:45.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57201a1c70 con 0x7f5720102640 2024-09-21T07:26:45.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571800be60 con 0x7f5720102640 2024-09-21T07:26:45.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.515+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57201a21b0 con 0x7f5720102640 2024-09-21T07:26:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.516+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5720102ab0 con 0x7f5720102640 2024-09-21T07:26:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.518+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5718003b70 con 0x7f5720102640 2024-09-21T07:26:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.519+0000 7f571e7fc640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f57080b6480 0x7f57080b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.519+0000 7f5724e58640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f57080b6480 0x7f57080b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.519+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f57180e57b0 con 0x7f5720102640 2024-09-21T07:26:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.519+0000 7f5724e58640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f57080b6480 0x7f57080b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5714000c00 tx=0x7f5714031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.521+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fd4a0102ab0 con 0x7fd4a01036d0 2024-09-21T07:26:45.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.522+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5718020070 con 0x7f5720102640 2024-09-21T07:26:45.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.526+0000 7fd49cff9640 1 -- 172.21.15.60:0/1194274491 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v26)=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7fd4a0102ab0 con 0x7fd4a01036d0 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd4880b6480 msgr2=0x7fd4880b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd4880b6480 0x7fd4880b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd490000c00 tx=0x7fd490031400 comp rx=0 tx=0).stop 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 msgr2=0x7fd4a0104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 0x7fd4a0104b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd49400e9f0 tx=0x7fd49400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 shutdown_connections 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd4880b6480 0x7fd4880b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4a0104070 0x7fd4a0105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a01036d0 0x7fd4a0104b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 --2- 172.21.15.60:0/1194274491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4a0102640 0x7fd4a0106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 >> 172.21.15.60:0/1194274491 conn(0x7fd4a00fdfb0 msgr2=0x7fd4a00ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 shutdown_connections 2024-09-21T07:26:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.529+0000 7fd4a61d7640 1 -- 172.21.15.60:0/1194274491 wait complete. 2024-09-21T07:26:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 -- 172.21.15.60:0/3408556630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23010b680 msgr2=0x7fd23010db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 --2- 172.21.15.60:0/3408556630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23010b680 0x7fd23010db90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd228009ca0 tx=0x7fd22802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 -- 172.21.15.60:0/3408556630 shutdown_connections 2024-09-21T07:26:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 --2- 172.21.15.60:0/3408556630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23010b680 0x7fd23010db90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 --2- 172.21.15.60:0/3408556630 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 0x7fd23010b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 --2- 172.21.15.60:0/3408556630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23006b7b0 0x7fd230108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 -- 172.21.15.60:0/3408556630 >> 172.21.15.60:0/3408556630 conn(0x7fd2300fdfb0 msgr2=0x7fd230100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 -- 172.21.15.60:0/3408556630 shutdown_connections 2024-09-21T07:26:45.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.700+0000 7fd237f3a640 1 -- 172.21.15.60:0/3408556630 wait complete. 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 Processor -- start 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 -- start start 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 0x7fd23019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 0x7fd23019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23010b680 0x7fd23019d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd230111430 con 0x7fd23006b7b0 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301112b0 con 0x7fd230108cd0 2024-09-21T07:26:45.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.701+0000 7fd237f3a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301115b0 con 0x7fd23010b680 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 0x7fd23019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd2354d5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 0x7fd23019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 0x7fd23019c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59230/0 (socket says 172.21.15.60:59230) 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 -- 172.21.15.60:0/782437164 learned_addr learned my addr 172.21.15.60:0/782437164 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd2354d5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 0x7fd23019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.60:39288/0 (socket says 172.21.15.60:39288) 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd2364d7640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23010b680 0x7fd23019d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 -- 172.21.15.60:0/782437164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23010b680 msgr2=0x7fd23019d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23010b680 0x7fd23019d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 -- 172.21.15.60:0/782437164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 msgr2=0x7fd23019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 0x7fd23019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 -- 172.21.15.60:0/782437164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23019da80 con 0x7fd23006b7b0 2024-09-21T07:26:45.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd235cd6640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 0x7fd23019c050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00d950 tx=0x7fd22c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.702+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c017070 con 0x7fd23006b7b0 2024-09-21T07:26:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.703+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23019dd70 con 0x7fd23006b7b0 2024-09-21T07:26:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.703+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2301a4470 con 0x7fd23006b7b0 2024-09-21T07:26:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.703+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd22c009c30 con 0x7fd23006b7b0 2024-09-21T07:26:45.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.703+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00f620 con 0x7fd23006b7b0 2024-09-21T07:26:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.704+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd230108790 con 0x7fd23006b7b0 2024-09-21T07:26:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.705+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd22c010460 con 0x7fd23006b7b0 2024-09-21T07:26:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.706+0000 7fd226ffd640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd21c0b6500 0x7fd21c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.706+0000 7fd2354d5640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd21c0b6500 0x7fd21c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.706+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd22c0e51d0 con 0x7fd23006b7b0 2024-09-21T07:26:45.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.707+0000 7fd2354d5640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd21c0b6500 0x7fd21c0b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd220009bd0 tx=0x7fd220005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:45.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.710+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd22c0ad730 con 0x7fd23006b7b0 2024-09-21T07:26:45.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.722+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f5720109820 con 0x7f5720102640 2024-09-21T07:26:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.726+0000 7f571e7fc640 1 -- 172.21.15.60:0/1571233152 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f5720109820 con 0x7f5720102640 2024-09-21T07:26:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f57080b6480 msgr2=0x7f57080b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f57080b6480 0x7f57080b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5714000c00 tx=0x7f5714031400 comp rx=0 tx=0).stop 2024-09-21T07:26:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 msgr2=0x7f572006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 0x7f572006b6a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f571800db80 tx=0x7f571800b630 comp rx=0 tx=0).stop 2024-09-21T07:26:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 shutdown_connections 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f57080b6480 0x7f57080b8990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720104070 0x7f57201a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57201036d0 0x7f572019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 --2- 172.21.15.60:0/1571233152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5720102640 0x7f572006b6a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 >> 172.21.15.60:0/1571233152 conn(0x7f57200fdfb0 msgr2=0x7f57201069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 shutdown_connections 2024-09-21T07:26:45.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.728+0000 7f57278bd640 1 -- 172.21.15.60:0/1571233152 wait complete. 2024-09-21T07:26:45.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.908+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fd230063fc0 con 0x7fd23006b7b0 2024-09-21T07:26:45.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.913+0000 7fd226ffd640 1 -- 172.21.15.60:0/782437164 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v28)=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7fd22c009de0 con 0x7fd23006b7b0 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd21c0b6500 msgr2=0x7fd21c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd21c0b6500 0x7fd21c0b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd220009bd0 tx=0x7fd220005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 msgr2=0x7fd23019c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 0x7fd23019c050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00d950 tx=0x7fd22c00de10 comp rx=0 tx=0).stop 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 shutdown_connections 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd21c0b6500 0x7fd21c0b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd23010b680 0x7fd23019d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd230108cd0 0x7fd23019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 --2- 172.21.15.60:0/782437164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd23006b7b0 0x7fd23019c050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 >> 172.21.15.60:0/782437164 conn(0x7fd2300fdfb0 msgr2=0x7fd230109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:45.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 shutdown_connections 2024-09-21T07:26:45.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.916+0000 7fd237f3a640 1 -- 172.21.15.60:0/782437164 wait complete. 2024-09-21T07:26:46.310 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:46 smithi060 ceph-mon[31244]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:46.310 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:46 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3598305806' entity='client.admin' 2024-09-21T07:26:46.310 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:46 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1194274491' entity='client.admin' 2024-09-21T07:26:46.311 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:46 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1571233152' entity='client.admin' 2024-09-21T07:26:46.311 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:46 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/782437164' entity='client.admin' 2024-09-21T07:26:46.401 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:46 smithi123 ceph-mon[34166]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:46.401 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:46 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3598305806' entity='client.admin' 2024-09-21T07:26:46.401 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:46 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1194274491' entity='client.admin' 2024-09-21T07:26:46.401 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:46 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1571233152' entity='client.admin' 2024-09-21T07:26:46.401 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:46 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/782437164' entity='client.admin' 2024-09-21T07:26:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:46 smithi187 ceph-mon[34367]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:46 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3598305806' entity='client.admin' 2024-09-21T07:26:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:46 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1194274491' entity='client.admin' 2024-09-21T07:26:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:46 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1571233152' entity='client.admin' 2024-09-21T07:26:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:46 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/782437164' entity='client.admin' 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 -- 172.21.15.60:0/1096468970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600104070 msgr2=0x7f060010aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 --2- 172.21.15.60:0/1096468970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600104070 0x7f060010aa10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009ca0 tx=0x7f05f802a950 comp rx=0 tx=0).stop 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 -- 172.21.15.60:0/1096468970 shutdown_connections 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 --2- 172.21.15.60:0/1096468970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600104070 0x7f060010aa10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 --2- 172.21.15.60:0/1096468970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06001036d0 0x7f0600103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 --2- 172.21.15.60:0/1096468970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 0x7f0600102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 -- 172.21.15.60:0/1096468970 >> 172.21.15.60:0/1096468970 conn(0x7f06000fdfb0 msgr2=0x7f0600100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:47.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 -- 172.21.15.60:0/1096468970 shutdown_connections 2024-09-21T07:26:47.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.203+0000 7f060858e640 1 -- 172.21.15.60:0/1096468970 wait complete. 2024-09-21T07:26:47.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 Processor -- start 2024-09-21T07:26:47.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 -- start start 2024-09-21T07:26:47.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 0x7f0600199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 0x7f060019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0600104070 0x7f060019b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f060010e130 con 0x7f06001036d0 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f060010dfb0 con 0x7f0600102640 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060858e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f060010e2b0 con 0x7f0600104070 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f0605b29640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 0x7f060019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f0605b29640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 0x7f060019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33966/0 (socket says 172.21.15.60:33966) 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f0605b29640 1 -- 172.21.15.60:0/3037179130 learned_addr learned my addr 172.21.15.60:0/3037179130 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f060632a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 0x7f0600199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f0606b2b640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0600104070 0x7f060019b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f0605b29640 1 -- 172.21.15.60:0/3037179130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0600104070 msgr2=0x7f060019b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.204+0000 7f0605b29640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0600104070 0x7f060019b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f0605b29640 1 -- 172.21.15.60:0/3037179130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 msgr2=0x7f0600199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f0605b29640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 0x7f0600199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f0605b29640 1 -- 172.21.15.60:0/3037179130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060019b8b0 con 0x7f06001036d0 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f060632a640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 0x7f0600199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f0605b29640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 0x7f060019a4f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f05f000d950 tx=0x7f05f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0017030 con 0x7f06001036d0 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f05f0004020 con 0x7f06001036d0 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060019bba0 con 0x7f06001036d0 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00055e0 con 0x7f06001036d0 2024-09-21T07:26:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.205+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001a22a0 con 0x7f06001036d0 2024-09-21T07:26:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.206+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0600102ab0 con 0x7f06001036d0 2024-09-21T07:26:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.208+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f05f0009a30 con 0x7f06001036d0 2024-09-21T07:26:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.208+0000 7f05f77fe640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f05ec0b6500 0x7f05ec0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.209+0000 7f060632a640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f05ec0b6500 0x7f05ec0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.209+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f05f00e4ec0 con 0x7f06001036d0 2024-09-21T07:26:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.209+0000 7f060632a640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f05ec0b6500 0x7f05ec0b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009fc0 tx=0x7f05fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:47.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.213+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05f00ad420 con 0x7f06001036d0 2024-09-21T07:26:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.403+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f06001a24d0 con 0x7f06001036d0 2024-09-21T07:26:47.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.407+0000 7f05f77fe640 1 -- 172.21.15.60:0/3037179130 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7f05f00b1800 con 0x7f06001036d0 2024-09-21T07:26:47.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.409+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f05ec0b6500 msgr2=0x7f05ec0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f05ec0b6500 0x7f05ec0b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009fc0 tx=0x7f05fc005f90 comp rx=0 tx=0).stop 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 msgr2=0x7f060019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 0x7f060019a4f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f05f000d950 tx=0x7f05f000de10 comp rx=0 tx=0).stop 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 shutdown_connections 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f05ec0b6500 0x7f05ec0b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0600104070 0x7f060019b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06001036d0 0x7f060019a4f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 --2- 172.21.15.60:0/3037179130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0600102640 0x7f0600199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 >> 172.21.15.60:0/3037179130 conn(0x7f06000fdfb0 msgr2=0x7f060006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 shutdown_connections 2024-09-21T07:26:47.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:47.410+0000 7f060858e640 1 -- 172.21.15.60:0/3037179130 wait complete. 2024-09-21T07:26:47.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:47 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2230464979' entity='client.admin' 2024-09-21T07:26:47.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:47 smithi123 ceph-mon[34166]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:47.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:47 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2230464979' entity='client.admin' 2024-09-21T07:26:47.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:47 smithi060 ceph-mon[31244]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:47.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:47 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2230464979' entity='client.admin' 2024-09-21T07:26:47.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:47 smithi187 ceph-mon[34367]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:48.117 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T07:26:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/2293023446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 msgr2=0x7f5b1810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/2293023446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1810aa10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009ca0 tx=0x7f5b1002a950 comp rx=0 tx=0).stop 2024-09-21T07:26:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/2293023446 shutdown_connections 2024-09-21T07:26:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/2293023446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1810aa10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/2293023446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b181036d0 0x7f5b18103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/2293023446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 0x7f5b18102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/2293023446 >> 172.21.15.60:0/2293023446 conn(0x7f5b180fdfb0 msgr2=0x7f5b18100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/2293023446 shutdown_connections 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.586+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/2293023446 wait complete. 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 Processor -- start 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 -- start start 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 0x7f5b18199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b181036d0 0x7f5b1819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1810e130 con 0x7f5b18104070 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1810dfb0 con 0x7f5b181036d0 2024-09-21T07:26:48.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1e7b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1810e2b0 con 0x7f5b18102640 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1cd53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.587+0000 7f5b1cd53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1819b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33990/0 (socket says 172.21.15.60:33990) 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 -- 172.21.15.60:0/104047037 learned_addr learned my addr 172.21.15.60:0/104047037 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b177fe640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b181036d0 0x7f5b1819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b17fff640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 0x7f5b18199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 -- 172.21.15.60:0/104047037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 msgr2=0x7f5b18199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 0x7f5b18199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 -- 172.21.15.60:0/104047037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b181036d0 msgr2=0x7f5b1819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b181036d0 0x7f5b1819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 -- 172.21.15.60:0/104047037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1819b8e0 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b17fff640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 0x7f5b18199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1cd53640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1819b0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b1002ae70 tx=0x7f5b10003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10034040 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5b1002fe00 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1819bb70 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10004760 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.588+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b181a22d0 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.589+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b18102ab0 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.591+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5b10037020 con 0x7f5b18104070 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.592+0000 7f5b157fa640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5b000b6500 0x7f5b000b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:48.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.593+0000 7f5b17fff640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5b000b6500 0x7f5b000b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:48.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.593+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5b101068b0 con 0x7f5b18104070 2024-09-21T07:26:48.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.593+0000 7f5b17fff640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5b000b6500 0x7f5b000b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b080058c0 tx=0x7f5b08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:48.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.596+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b10083710 con 0x7f5b18104070 2024-09-21T07:26:48.697 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:48 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3037179130' entity='client.admin' 2024-09-21T07:26:48.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:48 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3037179130' entity='client.admin' 2024-09-21T07:26:48.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.804+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f5b181a24a0 con 0x7f5b18104070 2024-09-21T07:26:48.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.805+0000 7f5b157fa640 1 -- 172.21.15.60:0/104047037 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7f5b100cee10 con 0x7f5b18104070 2024-09-21T07:26:48.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5b000b6500 msgr2=0x7f5b000b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5b000b6500 0x7f5b000b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b080058c0 tx=0x7f5b08005850 comp rx=0 tx=0).stop 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 msgr2=0x7f5b1819b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1819b0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b1002ae70 tx=0x7f5b10003f10 comp rx=0 tx=0).stop 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 shutdown_connections 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5b000b6500 0x7f5b000b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b18104070 0x7f5b1819b0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b181036d0 0x7f5b1819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 --2- 172.21.15.60:0/104047037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b18102640 0x7f5b18199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:48.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.807+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 >> 172.21.15.60:0/104047037 conn(0x7f5b180fdfb0 msgr2=0x7f5b180ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:48.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.808+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 shutdown_connections 2024-09-21T07:26:48.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:48.808+0000 7f5b1e7b6640 1 -- 172.21.15.60:0/104047037 wait complete. 2024-09-21T07:26:48.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:48 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3037179130' entity='client.admin' 2024-09-21T07:26:49.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/1576702705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb01094b0 msgr2=0x7fdbb010b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/1576702705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb01094b0 0x7fdbb010b9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009ca0 tx=0x7fdba802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/1576702705 shutdown_connections 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/1576702705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb01094b0 0x7fdbb010b9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/1576702705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0102570 0x7fdbb0108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/1576702705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbb0101b40 0x7fdbb0101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/1576702705 >> 172.21.15.60:0/1576702705 conn(0x7fdbb00fd770 msgr2=0x7fdbb00ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.206+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/1576702705 shutdown_connections 2024-09-21T07:26:49.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.207+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/1576702705 wait complete. 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.207+0000 7fdbb4eb3640 1 Processor -- start 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.207+0000 7fdbb4eb3640 1 -- start start 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbb4eb3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0101b40 0x7fdbb019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbb4eb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 0x7fdbb019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbb4eb3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbb01094b0 0x7fdbb019d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbb4eb3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb010f280 con 0x7fdbb0102570 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbb4eb3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb010f100 con 0x7fdbb0101b40 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbb4eb3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb010f400 con 0x7fdbb01094b0 2024-09-21T07:26:49.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 0x7fdbb019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 0x7fdbb019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34012/0 (socket says 172.21.15.60:34012) 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbae59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0101b40 0x7fdbb019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 -- 172.21.15.60:0/3424025759 learned_addr learned my addr 172.21.15.60:0/3424025759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbaed9d640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbb01094b0 0x7fdbb019d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 -- 172.21.15.60:0/3424025759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbb01094b0 msgr2=0x7fdbb019d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbb01094b0 0x7fdbb019d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 -- 172.21.15.60:0/3424025759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0101b40 msgr2=0x7fdbb019c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0101b40 0x7fdbb019c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 -- 172.21.15.60:0/3424025759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb019da80 con 0x7fdbb0102570 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdbae59c640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0101b40 0x7fdbb019c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba7fff640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 0x7fdbb019c6c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800d950 tx=0x7fdb9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb98017030 con 0x7fdbb0102570 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.208+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdb98004020 con 0x7fdbb0102570 2024-09-21T07:26:49.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.209+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb019dd70 con 0x7fdbb0102570 2024-09-21T07:26:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.209+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980055e0 con 0x7fdbb0102570 2024-09-21T07:26:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.209+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb01a4470 con 0x7fdbb0102570 2024-09-21T07:26:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.210+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb0101f50 con 0x7fdbb0102570 2024-09-21T07:26:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.211+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fdb98009a30 con 0x7fdbb0102570 2024-09-21T07:26:49.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.212+0000 7fdba77fe640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdb9c0b6500 0x7fdb9c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.212+0000 7fdbae59c640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdb9c0b6500 0x7fdb9c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.212+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdb980e5660 con 0x7fdbb0102570 2024-09-21T07:26:49.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.212+0000 7fdbae59c640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdb9c0b6500 0x7fdb9c0b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdba00058c0 tx=0x7fdba000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.215+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb980adba0 con 0x7fdbb0102570 2024-09-21T07:26:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.409+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fdbb010afd0 con 0x7fdbb0102570 2024-09-21T07:26:49.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.418+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) ==== 123+0+0 (secure 0 0 0) 0x7fdbb010afd0 con 0x7fdbb0102570 2024-09-21T07:26:49.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.419+0000 7fdba77fe640 1 -- 172.21.15.60:0/3424025759 <== mon.0 v2:172.21.15.60:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb980acfb0 con 0x7fdbb0102570 2024-09-21T07:26:49.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.420+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdb9c0b6500 msgr2=0x7fdb9c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.420+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdb9c0b6500 0x7fdb9c0b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdba00058c0 tx=0x7fdba000a250 comp rx=0 tx=0).stop 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.420+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 msgr2=0x7fdbb019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.420+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 0x7fdbb019c6c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800d950 tx=0x7fdb9800de10 comp rx=0 tx=0).stop 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 shutdown_connections 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdb9c0b6500 0x7fdb9c0b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbb01094b0 0x7fdbb019d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbb0102570 0x7fdbb019c6c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 --2- 172.21.15.60:0/3424025759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbb0101b40 0x7fdbb019c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 >> 172.21.15.60:0/3424025759 conn(0x7fdbb00fd770 msgr2=0x7fdbb0107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 shutdown_connections 2024-09-21T07:26:49.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.421+0000 7fdbb4eb3640 1 -- 172.21.15.60:0/3424025759 wait complete. 2024-09-21T07:26:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 -- 172.21.15.60:0/526739624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 msgr2=0x7f2ce410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/526739624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce410aa30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009ca0 tx=0x7f2cdc02a950 comp rx=0 tx=0).stop 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 -- 172.21.15.60:0/526739624 shutdown_connections 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/526739624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce410aa30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/526739624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce41036f0 0x7f2ce4103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/526739624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ce4102660 0x7f2ce4102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 -- 172.21.15.60:0/526739624 >> 172.21.15.60:0/526739624 conn(0x7f2ce40fdfd0 msgr2=0x7f2ce4100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 -- 172.21.15.60:0/526739624 shutdown_connections 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.424+0000 7f2ce90c6640 1 -- 172.21.15.60:0/526739624 wait complete. 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 Processor -- start 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 -- start start 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce4102660 0x7f2ce4106250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ce41036f0 0x7f2ce4104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce4105060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce410e290 con 0x7f2ce4104090 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.425+0000 7f2ce90c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce410e110 con 0x7f2ce4102660 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce90c6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce410e410 con 0x7f2ce41036f0 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce4105060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce4105060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34036/0 (socket says 172.21.15.60:34036) 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 -- 172.21.15.60:0/1705531553 learned_addr learned my addr 172.21.15.60:0/1705531553 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce2d9d640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce4102660 0x7f2ce4106250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce259c640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ce41036f0 0x7f2ce4104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 -- 172.21.15.60:0/1705531553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ce41036f0 msgr2=0x7f2ce4104b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ce41036f0 0x7f2ce4104b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 -- 172.21.15.60:0/1705531553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce4102660 msgr2=0x7f2ce4106250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce4102660 0x7f2ce4106250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 -- 172.21.15.60:0/1705531553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce41056d0 con 0x7f2ce4104090 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ce359e640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce4105060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006010 tx=0x7f2cdc031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.426+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc034040 con 0x7f2ce4104090 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.427+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce4105960 con 0x7f2ce4104090 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.427+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cdc0308f0 con 0x7f2ce4104090 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.427+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004690 con 0x7f2ce4104090 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.427+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce41a4360 con 0x7f2ce4104090 2024-09-21T07:26:49.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.429+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce41a45c0 con 0x7f2ce4104090 2024-09-21T07:26:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.430+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2cdc037020 con 0x7f2ce4104090 2024-09-21T07:26:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.431+0000 7f2ccbfff640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2ccc0b6480 0x7f2ccc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.431+0000 7f2ce2d9d640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2ccc0b6480 0x7f2ccc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.431+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2cdc106360 con 0x7f2ce4104090 2024-09-21T07:26:49.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.431+0000 7f2ce2d9d640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2ccc0b6480 0x7f2ccc0b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400abe0 tx=0x7f2cd400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.436+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cdc0ce8c0 con 0x7f2ce4104090 2024-09-21T07:26:49.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.637+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f2ce41a4bc0 con 0x7f2ce4104090 2024-09-21T07:26:49.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.642+0000 7f2ccbfff640 1 -- 172.21.15.60:0/1705531553 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f2cdc0d2ca0 con 0x7f2ce4104090 2024-09-21T07:26:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2ccc0b6480 msgr2=0x7f2ccc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2ccc0b6480 0x7f2ccc0b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400abe0 tx=0x7f2cd400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 msgr2=0x7f2ce4105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce4105060 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006010 tx=0x7f2cdc031cb0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 shutdown_connections 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2ccc0b6480 0x7f2ccc0b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce4104090 0x7f2ce4105060 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ce41036f0 0x7f2ce4104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 --2- 172.21.15.60:0/1705531553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ce4102660 0x7f2ce4106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.644+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 >> 172.21.15.60:0/1705531553 conn(0x7f2ce40fdfd0 msgr2=0x7f2ce406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.645+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 shutdown_connections 2024-09-21T07:26:49.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:49.645+0000 7f2ce90c6640 1 -- 172.21.15.60:0/1705531553 wait complete. 2024-09-21T07:26:49.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 -- 172.21.15.60:0/1640616477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0670105180 msgr2=0x7f067010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 --2- 172.21.15.60:0/1640616477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0670105180 0x7f067010bb20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0668009ca0 tx=0x7f066802a950 comp rx=0 tx=0).stop 2024-09-21T07:26:49.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 -- 172.21.15.60:0/1640616477 shutdown_connections 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 --2- 172.21.15.60:0/1640616477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0670105180 0x7f067010bb20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 --2- 172.21.15.60:0/1640616477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06701047e0 0x7f0670104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 --2- 172.21.15.60:0/1640616477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 0x7f0670103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 -- 172.21.15.60:0/1640616477 >> 172.21.15.60:0/1640616477 conn(0x7f06700ff0c0 msgr2=0x7f0670101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 -- 172.21.15.60:0/1640616477 shutdown_connections 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.109+0000 7f067722a640 1 -- 172.21.15.60:0/1640616477 wait complete. 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 Processor -- start 2024-09-21T07:26:49.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 -- start start 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 0x7f0670199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 0x7f067019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0670105180 0x7f067019b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f067010f240 con 0x7f06701047e0 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f067010f0c0 con 0x7f0670105180 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f067722a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f067010f3c0 con 0x7f0670103750 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f066ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 0x7f067019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f066ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 0x7f067019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59242/0 (socket says 172.21.15.60:59242) 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f066ffff640 1 -- 172.21.15.60:0/2230464979 learned_addr learned my addr 172.21.15.60:0/2230464979 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f06757c7640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0670105180 0x7f067019b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.110+0000 7f0674fc6640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 0x7f0670199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066ffff640 1 -- 172.21.15.60:0/2230464979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 msgr2=0x7f0670199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066ffff640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 0x7f0670199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066ffff640 1 -- 172.21.15.60:0/2230464979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0670105180 msgr2=0x7f067019b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066ffff640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0670105180 0x7f067019b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066ffff640 1 -- 172.21.15.60:0/2230464979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067019b7f0 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f0674fc6640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 0x7f0670199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066ffff640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 0x7f067019a530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f065c00d950 tx=0x7f065c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c017030 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f065c004020 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067019bae0 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c0055e0 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.111+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06701a2270 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.112+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0670103bc0 con 0x7f06701047e0 2024-09-21T07:26:49.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.114+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f065c009a30 con 0x7f06701047e0 2024-09-21T07:26:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.115+0000 7f066dffb640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f06600b6480 0x7f06600b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.115+0000 7f0674fc6640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f06600b6480 0x7f06600b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.115+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f065c0e50f0 con 0x7f06701047e0 2024-09-21T07:26:49.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.115+0000 7f0674fc6640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f06600b6480 0x7f06600b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f066400baa0 tx=0x7f0664005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.121+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f065c0ad650 con 0x7f06701047e0 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.308+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f0670063fc0 con 0x7f06701047e0 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.313+0000 7f066dffb640 1 -- 172.21.15.60:0/2230464979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f065c0b1a30 con 0x7f06701047e0 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f06600b6480 msgr2=0x7f06600b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f06600b6480 0x7f06600b8990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f066400baa0 tx=0x7f0664005d90 comp rx=0 tx=0).stop 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 msgr2=0x7f067019a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 0x7f067019a530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f065c00d950 tx=0x7f065c00de10 comp rx=0 tx=0).stop 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 shutdown_connections 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f06600b6480 0x7f06600b8990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0670105180 0x7f067019b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06701047e0 0x7f067019a530 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 --2- 172.21.15.60:0/2230464979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0670103750 0x7f0670199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 >> 172.21.15.60:0/2230464979 conn(0x7f06700ff0c0 msgr2=0x7f0670107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 shutdown_connections 2024-09-21T07:26:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:46.315+0000 7f067722a640 1 -- 172.21.15.60:0/2230464979 wait complete. 2024-09-21T07:26:49.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:49 smithi060 ceph-mon[31244]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:49.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:49 smithi187 ceph-mon[34367]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:49.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:49 smithi123 ceph-mon[34166]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:50.464 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:50 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3424025759' entity='client.admin' 2024-09-21T07:26:50.464 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:50 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1705531553' entity='client.admin' 2024-09-21T07:26:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:50 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3424025759' entity='client.admin' 2024-09-21T07:26:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:50 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1705531553' entity='client.admin' 2024-09-21T07:26:50.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:50 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3424025759' entity='client.admin' 2024-09-21T07:26:50.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:50 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1705531553' entity='client.admin' 2024-09-21T07:26:51.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:51 smithi060 ceph-mon[31244]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:51 smithi187 ceph-mon[34367]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:51.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:51 smithi123 ceph-mon[34166]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:52.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T07:26:52.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi060') 2024-09-21T07:26:52.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi060') 2024-09-21T07:26:52.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi060') 2024-09-21T07:26:52.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi060') 2024-09-21T07:26:52.147 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.079 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.080 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.080 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.080 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.080 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.080 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi060') 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 -- 172.21.15.60:0/2855239072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370006b980 msgr2=0x7f3700106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 --2- 172.21.15.60:0/2855239072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370006b980 0x7f3700106390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36f0009900 tx=0x7f36f002a410 comp rx=0 tx=0).stop 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 -- 172.21.15.60:0/2855239072 shutdown_connections 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 --2- 172.21.15.60:0/2855239072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3700109470 0x7f370010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 --2- 172.21.15.60:0/2855239072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37001068d0 0x7f3700108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 --2- 172.21.15.60:0/2855239072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370006b980 0x7f3700106390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 -- 172.21.15.60:0/2855239072 >> 172.21.15.60:0/2855239072 conn(0x7f37000fdfb0 msgr2=0x7f3700100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 -- 172.21.15.60:0/2855239072 shutdown_connections 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.228+0000 7f37068cd640 1 -- 172.21.15.60:0/2855239072 wait complete. 2024-09-21T07:26:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.229+0000 7f37068cd640 1 Processor -- start 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.229+0000 7f37068cd640 1 -- start start 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.229+0000 7f37068cd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370006b980 0x7f3700199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.229+0000 7f37068cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 0x7f370019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f37068cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3700109470 0x7f370019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f37068cd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f370010f220 con 0x7f37001068d0 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f37068cd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f370010f0a0 con 0x7f3700109470 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f37068cd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f370010f3a0 con 0x7f370006b980 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 0x7f370019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 0x7f370019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59190/0 (socket says 172.21.15.60:59190) 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 -- 172.21.15.60:0/3598305806 learned_addr learned my addr 172.21.15.60:0/3598305806 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f3704e6a640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3700109470 0x7f370019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36fffff640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370006b980 0x7f3700199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 -- 172.21.15.60:0/3598305806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370006b980 msgr2=0x7f3700199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370006b980 0x7f3700199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 -- 172.21.15.60:0/3598305806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3700109470 msgr2=0x7f370019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3700109470 0x7f370019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 -- 172.21.15.60:0/3598305806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370019b900 con 0x7f37001068d0 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.230+0000 7f36ff7fe640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 0x7f370019a540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36f400d950 tx=0x7f36f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.231+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4017070 con 0x7f37001068d0 2024-09-21T07:26:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.231+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370019bbf0 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.231+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f36f4009c30 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.231+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f400f620 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.231+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37001a22f0 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.232+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37000ffad0 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.233+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f36f4010460 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.234+0000 7f36fd7fa640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36e80b6500 0x7f36e80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.234+0000 7f36fffff640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36e80b6500 0x7f36e80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.234+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f36f40e51f0 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.235+0000 7f36fffff640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36e80b6500 0x7f36e80b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36f0000c00 tx=0x7f36f0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.237+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36f4009de0 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.432+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3700106ce0 con 0x7f37001068d0 2024-09-21T07:26:53.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.438+0000 7f36fd7fa640 1 -- 172.21.15.60:0/3598305806 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f36f40b1a90 con 0x7f37001068d0 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36e80b6500 msgr2=0x7f36e80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36e80b6500 0x7f36e80b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36f0000c00 tx=0x7f36f0031400 comp rx=0 tx=0).stop 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 msgr2=0x7f370019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 0x7f370019a540 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36f400d950 tx=0x7f36f400de10 comp rx=0 tx=0).stop 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 shutdown_connections 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36e80b6500 0x7f36e80b8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3700109470 0x7f370019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37001068d0 0x7f370019a540 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 --2- 172.21.15.60:0/3598305806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f370006b980 0x7f3700199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 >> 172.21.15.60:0/3598305806 conn(0x7f37000fdfb0 msgr2=0x7f3700104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 shutdown_connections 2024-09-21T07:26:53.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:45.440+0000 7f37068cd640 1 -- 172.21.15.60:0/3598305806 wait complete. 2024-09-21T07:26:53.659 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:53 smithi060 ceph-mon[31244]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:53.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:53 smithi123 ceph-mon[34166]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:54.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:53 smithi187 ceph-mon[34367]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:54.345 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:55.135 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi060') 2024-09-21T07:26:55.135 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T07:26:55.135 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi060') 2024-09-21T07:26:55.135 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi060') 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 -- 172.21.15.60:0/3610731629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc0770e0 msgr2=0x7f7cbc0757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 --2- 172.21.15.60:0/3610731629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc0770e0 0x7f7cbc0757b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009900 tx=0x7f7cb802a410 comp rx=0 tx=0).stop 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 -- 172.21.15.60:0/3610731629 shutdown_connections 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 --2- 172.21.15.60:0/3610731629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cbc10b6f0 0x7f7cbc10db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 --2- 172.21.15.60:0/3610731629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 --2- 172.21.15.60:0/3610731629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc0770e0 0x7f7cbc0757b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 -- 172.21.15.60:0/3610731629 >> 172.21.15.60:0/3610731629 conn(0x7f7cbc0ff0c0 msgr2=0x7f7cbc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 -- 172.21.15.60:0/3610731629 shutdown_connections 2024-09-21T07:26:55.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.569+0000 7f7cc4060640 1 -- 172.21.15.60:0/3610731629 wait complete. 2024-09-21T07:26:55.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.570+0000 7f7cc4060640 1 Processor -- start 2024-09-21T07:26:55.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.570+0000 7f7cc4060640 1 -- start start 2024-09-21T07:26:55.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.570+0000 7f7cc4060640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc4060640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cbc0770e0 0x7f7cbc19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc4060640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc10b6f0 0x7f7cbc19d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc4060640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc111630 con 0x7f7cbc075cf0 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc4060640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc1114b0 con 0x7f7cbc10b6f0 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc4060640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc1117b0 con 0x7f7cbc0770e0 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc19c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34050/0 (socket says 172.21.15.60:34050) 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 -- 172.21.15.60:0/2961662434 learned_addr learned my addr 172.21.15.60:0/2961662434 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc15fb640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cbc0770e0 0x7f7cbc19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc25fd640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc10b6f0 0x7f7cbc19d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 -- 172.21.15.60:0/2961662434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cbc0770e0 msgr2=0x7f7cbc19c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cbc0770e0 0x7f7cbc19c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 -- 172.21.15.60:0/2961662434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc10b6f0 msgr2=0x7f7cbc19d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc10b6f0 0x7f7cbc19d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 -- 172.21.15.60:0/2961662434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc19dc50 con 0x7f7cbc075cf0 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc25fd640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc10b6f0 0x7f7cbc19d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cc1dfc640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc19c220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8031440 tx=0x7f7cb8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.571+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb803f070 con 0x7f7cbc075cf0 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.572+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cbc19dee0 con 0x7f7cbc075cf0 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.572+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb8031c50 con 0x7f7cbc075cf0 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.572+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8035030 con 0x7f7cbc075cf0 2024-09-21T07:26:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.572+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cbc1a44f0 con 0x7f7cbc075cf0 2024-09-21T07:26:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.573+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cbc10a500 con 0x7f7cbc075cf0 2024-09-21T07:26:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.574+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f7cb8042070 con 0x7f7cbc075cf0 2024-09-21T07:26:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.575+0000 7f7cb2ffd640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7ca80b6500 0x7f7ca80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.575+0000 7f7cc15fb640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7ca80b6500 0x7f7ca80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.575+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7cb8106660 con 0x7f7cbc075cf0 2024-09-21T07:26:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.576+0000 7f7cc15fb640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7ca80b6500 0x7f7ca80b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00bbe0 tx=0x7f7cac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:55.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.579+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cb80ceb20 con 0x7f7cbc075cf0 2024-09-21T07:26:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.770+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f7cbc02e640 con 0x7f7cbc075cf0 2024-09-21T07:26:55.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:55 smithi060 ceph-mon[31244]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.774+0000 7f7cb2ffd640 1 -- 172.21.15.60:0/2961662434 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f7cb80d2f00 con 0x7f7cbc075cf0 2024-09-21T07:26:55.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.776+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7ca80b6500 msgr2=0x7f7ca80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.776+0000 7f7cc4060640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7ca80b6500 0x7f7ca80b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00bbe0 tx=0x7f7cac00b390 comp rx=0 tx=0).stop 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.776+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 msgr2=0x7f7cbc19c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.776+0000 7f7cc4060640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc19c220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8031440 tx=0x7f7cb8003c10 comp rx=0 tx=0).stop 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 shutdown_connections 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7ca80b6500 0x7f7ca80b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cbc10b6f0 0x7f7cbc19d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cbc0770e0 0x7f7cbc19c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 --2- 172.21.15.60:0/2961662434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cbc075cf0 0x7f7cbc19c220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 >> 172.21.15.60:0/2961662434 conn(0x7f7cbc0ff0c0 msgr2=0x7f7cbc1076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 shutdown_connections 2024-09-21T07:26:55.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:55.777+0000 7f7cc4060640 1 -- 172.21.15.60:0/2961662434 wait complete. 2024-09-21T07:26:55.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:55 smithi123 ceph-mon[34166]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:56.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:55 smithi187 ceph-mon[34367]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:57.059 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:56 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2961662434' entity='client.admin' 2024-09-21T07:26:57.059 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:57.059 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:57.059 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:57.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:56 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2961662434' entity='client.admin' 2024-09-21T07:26:57.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:57.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:57.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:57.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:56 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2961662434' entity='client.admin' 2024-09-21T07:26:57.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:57.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:57.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:26:57.687 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi060') 2024-09-21T07:26:57.688 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi060') 2024-09-21T07:26:57.688 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi060') 2024-09-21T07:26:57.688 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi060') 2024-09-21T07:26:57.688 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi060') 2024-09-21T07:26:57.688 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '679a927c-77ea-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi060') 2024-09-21T07:26:57.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T07:26:57.972 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:26:58.230 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:57 smithi060 ceph-mon[31244]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:58.230 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:58.230 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:58.230 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:57 smithi187 ceph-mon[34367]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:58.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:58.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:57 smithi123 ceph-mon[34166]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:26:58.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:26:58.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:26:58.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 -- 172.21.15.60:0/2429443456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102670 msgr2=0x7fa514102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 --2- 172.21.15.60:0/2429443456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102670 0x7fa514102ae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51002a480 comp rx=0 tx=0).stop 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 -- 172.21.15.60:0/2429443456 shutdown_connections 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 --2- 172.21.15.60:0/2429443456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5141040a0 0x7fa51410aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 --2- 172.21.15.60:0/2429443456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa514103700 0x7fa514103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 --2- 172.21.15.60:0/2429443456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514102670 0x7fa514102ae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 -- 172.21.15.60:0/2429443456 >> 172.21.15.60:0/2429443456 conn(0x7fa5140fdfe0 msgr2=0x7fa514100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 -- 172.21.15.60:0/2429443456 shutdown_connections 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.443+0000 7fa51c12a640 1 -- 172.21.15.60:0/2429443456 wait complete. 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 Processor -- start 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 -- start start 2024-09-21T07:26:58.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa514102670 0x7fa514106260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 0x7fa514104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5141040a0 0x7fa514105070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410e2b0 con 0x7fa514103700 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410e130 con 0x7fa5141040a0 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51c12a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa51410e430 con 0x7fa514102670 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa5196c5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 0x7fa514104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa5196c5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 0x7fa514104b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37424/0 (socket says 172.21.15.60:37424) 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa5196c5640 1 -- 172.21.15.60:0/3751698006 learned_addr learned my addr 172.21.15.60:0/3751698006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa51a6c7640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5141040a0 0x7fa514105070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.444+0000 7fa519ec6640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa514102670 0x7fa514106260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa5196c5640 1 -- 172.21.15.60:0/3751698006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa514102670 msgr2=0x7fa514106260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa5196c5640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa514102670 0x7fa514106260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa5196c5640 1 -- 172.21.15.60:0/3751698006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5141040a0 msgr2=0x7fa514105070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:58.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa5196c5640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5141040a0 0x7fa514105070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa5196c5640 1 -- 172.21.15.60:0/3751698006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa514105770 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa5196c5640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 0x7fa514104b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d770 tx=0x7fa50400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504017070 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5141a4060 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5040054d0 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504004c30 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.445+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5141a44c0 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.446+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5141a46f0 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.449+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa504004dd0 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.450+0000 7fa50affd640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa5000b6480 0x7fa5000b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.450+0000 7fa519ec6640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa5000b6480 0x7fa5000b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.450+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5040e5520 con 0x7fa514103700 2024-09-21T07:26:58.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.450+0000 7fa519ec6640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa5000b6480 0x7fa5000b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa510031440 tx=0x7fa5100314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:26:58.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.453+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5040ada60 con 0x7fa514103700 2024-09-21T07:26:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.648+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fa5141a48c0 con 0x7fa514103700 2024-09-21T07:26:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.649+0000 7fa50affd640 1 -- 172.21.15.60:0/3751698006 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21721 (secure 0 0 0) 0x7fa5040b1e40 con 0x7fa514103700 2024-09-21T07:26:58.651 INFO:teuthology.orchestra.run.smithi060.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:26:58.651 INFO:teuthology.orchestra.run.smithi060.stdout:global dev auth_debug true 2024-09-21T07:26:58.651 INFO:teuthology.orchestra.run.smithi060.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T07:26:58.651 INFO:teuthology.orchestra.run.smithi060.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T07:26:58.651 INFO:teuthology.orchestra.run.smithi060.stdout:global basic log_to_file true 2024-09-21T07:26:58.651 INFO:teuthology.orchestra.run.smithi060.stdout:global basic log_to_journald false 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global basic log_to_stderr false 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_allow_pool_delete true 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T07:26:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:global dev ms_die_on_bug true 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:global dev ms_die_on_old_message true 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:global dev ms_die_on_skipped_message false 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced debug_mon 20/20 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced debug_ms 1/1 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced debug_paxos 20/20 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T07:26:58.653 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced debug_client 20/20 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:26:58.654 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev bdev_debug_aio true 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced bdev_enable_discard true 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T07:26:58.655 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced debug_bluefs 1/20 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced debug_bluestore 1/20 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced debug_ms 1/1 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced debug_osd 20/20 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_op_order true 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_shutdown true 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T07:26:58.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T07:26:58.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced debug_mds 20/20 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:26:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced debug_ms 2/2 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_bal_split_size 100 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds dev mds_debug_frag true 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds dev mds_verify_scatter true 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:26:58.659 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client advanced client_mount_timeout 600 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client advanced debug_client 20/20 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client advanced debug_ms 1/1 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T07:26:58.660 INFO:teuthology.orchestra.run.smithi060.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T07:26:58.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa5000b6480 msgr2=0x7fa5000b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:58.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa5000b6480 0x7fa5000b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa510031440 tx=0x7fa5100314a0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 msgr2=0x7fa514104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:26:58.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 0x7fa514104b30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d770 tx=0x7fa50400dc30 comp rx=0 tx=0).stop 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 shutdown_connections 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa5000b6480 0x7fa5000b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5141040a0 0x7fa514105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa514103700 0x7fa514104b30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 --2- 172.21.15.60:0/3751698006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa514102670 0x7fa514106260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.651+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 >> 172.21.15.60:0/3751698006 conn(0x7fa5140fdfe0 msgr2=0x7fa5140ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.652+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 shutdown_connections 2024-09-21T07:26:58.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:26:58.652+0000 7fa51c12a640 1 -- 172.21.15.60:0/3751698006 wait complete. 2024-09-21T07:26:59.243 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:58 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3751698006' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:26:59.244 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T07:26:59.244 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:26:59.245 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:26:59.262 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:26:59.262 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-21T07:26:59.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:58 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3751698006' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:26:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:26:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:26:59.319 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T07:26:59.319 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:26:59.319 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:26:59.319 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 07:25:46.809669038 +0000 2024-09-21T07:26:59.320 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 07:21:11.853636472 +0000 2024-09-21T07:26:59.320 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 07:21:11.853636472 +0000 2024-09-21T07:26:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 07:21:11.853636472 +0000 2024-09-21T07:26:59.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:26:59.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:58 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3751698006' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:26:59.387 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T07:26:59.387 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T07:26:59.387 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000114338 s, 4.5 MB/s 2024-09-21T07:26:59.389 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:26:59.451 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-21T07:26:59.509 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:26:59.509 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:26:59.509 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T07:26:59.509 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:26:59.510 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:26:59.510 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 07:25:46.847668719 +0000 2024-09-21T07:26:59.510 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 07:21:12.167633887 +0000 2024-09-21T07:26:59.510 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 07:21:12.167633887 +0000 2024-09-21T07:26:59.510 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 07:21:12.167633887 +0000 2024-09-21T07:26:59.511 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:26:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T07:26:59.579 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T07:26:59.580 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 9.1685e-05 s, 5.6 MB/s 2024-09-21T07:26:59.581 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:26:59.641 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-21T07:26:59.701 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:26:59.701 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:26:59.701 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T07:26:59.702 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:26:59.702 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:26:59.702 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 07:25:46.881668434 +0000 2024-09-21T07:26:59.702 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 07:21:12.488631244 +0000 2024-09-21T07:26:59.702 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 07:21:12.488631244 +0000 2024-09-21T07:26:59.702 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 07:21:12.488631244 +0000 2024-09-21T07:26:59.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:26:59.769 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T07:26:59.770 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T07:26:59.770 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000112821 s, 4.5 MB/s 2024-09-21T07:26:59.771 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:26:59.832 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-21T07:26:59.889 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:26:59.889 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:26:59.889 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T07:26:59.889 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:26:59.889 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:26:59.890 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 07:25:46.915668149 +0000 2024-09-21T07:26:59.890 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 07:21:12.808628610 +0000 2024-09-21T07:26:59.890 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 07:21:12.808628610 +0000 2024-09-21T07:26:59.890 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 07:21:12.808628610 +0000 2024-09-21T07:26:59.890 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:26:59.956 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T07:26:59.956 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T07:26:59.956 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000109046 s, 4.7 MB/s 2024-09-21T07:26:59.957 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:27:00.015 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-21T07:27:00.015 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:27:00.036 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:27:00.036 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-09-21T07:27:00.095 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:27:00.095 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 07:26:34.639885840 +0000 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 07:21:26.074745815 +0000 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 07:21:26.074745815 +0000 2024-09-21T07:27:00.096 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 07:21:26.074745815 +0000 2024-09-21T07:27:00.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:27:00.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T07:27:00.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T07:27:00.167 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000237739 s, 2.2 MB/s 2024-09-21T07:27:00.168 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:27:00.228 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-09-21T07:27:00.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:26:59 smithi187 ceph-mon[34367]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 07:26:34.639885840 +0000 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 07:21:26.391738213 +0000 2024-09-21T07:27:00.287 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 07:21:26.391738213 +0000 2024-09-21T07:27:00.288 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 07:21:26.391738213 +0000 2024-09-21T07:27:00.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:27:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:26:59 smithi123 ceph-mon[34166]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T07:27:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T07:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000297577 s, 1.7 MB/s 2024-09-21T07:27:00.356 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:27:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:26:59 smithi060 ceph-mon[31244]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:00.414 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-09-21T07:27:00.471 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:27:00.471 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:00.471 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T07:27:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 07:26:34.639885840 +0000 2024-09-21T07:27:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 07:21:26.706730658 +0000 2024-09-21T07:27:00.472 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 07:21:26.706730658 +0000 2024-09-21T07:27:00.472 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 07:21:26.706730658 +0000 2024-09-21T07:27:00.472 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:27:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T07:27:00.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T07:27:00.537 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000207552 s, 2.5 MB/s 2024-09-21T07:27:00.538 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:27:00.595 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-09-21T07:27:00.651 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-21 07:26:34.640885817 +0000 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-21 07:21:27.033722816 +0000 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-21 07:21:27.033722816 +0000 2024-09-21T07:27:00.652 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-21 07:21:27.033722816 +0000 2024-09-21T07:27:00.652 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:27:00.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-21T07:27:00.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-21T07:27:00.715 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000186332 s, 2.7 MB/s 2024-09-21T07:27:00.716 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:27:00.774 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-21T07:27:00.774 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:27:00.794 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:27:00.794 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-09-21T07:27:00.854 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:27:00.854 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:00.855 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-21T07:27:00.855 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:00.855 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:00.855 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 07:26:32.289586730 +0000 2024-09-21T07:27:00.855 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 07:21:26.190612066 +0000 2024-09-21T07:27:00.856 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 07:21:26.190612066 +0000 2024-09-21T07:27:00.856 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 07:21:26.190612066 +0000 2024-09-21T07:27:00.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:27:00.926 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T07:27:00.926 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T07:27:00.926 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000295098 s, 1.7 MB/s 2024-09-21T07:27:00.927 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:27:00.987 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-09-21T07:27:01.046 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:27:01.046 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:01.046 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T07:27:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 07:26:32.289586730 +0000 2024-09-21T07:27:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 07:21:26.512607183 +0000 2024-09-21T07:27:01.047 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 07:21:26.512607183 +0000 2024-09-21T07:27:01.047 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 07:21:26.512607183 +0000 2024-09-21T07:27:01.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:27:01.113 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T07:27:01.113 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T07:27:01.113 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000260202 s, 2.0 MB/s 2024-09-21T07:27:01.114 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:27:01.174 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-09-21T07:27:01.230 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:27:01.230 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:01.230 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-09-21T07:27:01.231 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:01.231 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:01.231 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 07:26:32.289586730 +0000 2024-09-21T07:27:01.231 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 07:21:26.829602375 +0000 2024-09-21T07:27:01.231 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 07:21:26.829602375 +0000 2024-09-21T07:27:01.231 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 07:21:26.829602375 +0000 2024-09-21T07:27:01.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:27:01.296 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T07:27:01.296 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T07:27:01.296 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000227003 s, 2.3 MB/s 2024-09-21T07:27:01.297 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:27:01.355 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-21 07:26:32.290586715 +0000 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-21 07:21:27.148597537 +0000 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-21 07:21:27.148597537 +0000 2024-09-21T07:27:01.411 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2024-09-21 07:21:27.148597537 +0000 2024-09-21T07:27:01.411 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:27:01.476 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-21T07:27:01.476 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-21T07:27:01.476 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000297703 s, 1.7 MB/s 2024-09-21T07:27:01.477 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:27:01.534 INFO:tasks.cephadm:Deploying osd.0 on smithi060 with /dev/vg_nvme/lv_4... 2024-09-21T07:27:01.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:27:01.797 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:27:02.192 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:01 smithi060 ceph-mon[31244]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:01 smithi187 ceph-mon[34367]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:01 smithi123 ceph-mon[34166]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:04.232 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:27:04.260 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:03 smithi060 ceph-mon[31244]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:04.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-09-21T07:27:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:03 smithi187 ceph-mon[34367]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:03 smithi123 ceph-mon[34166]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 -- 172.21.15.60:0/1848820120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3348103750 msgr2=0x7f3348103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 --2- 172.21.15.60:0/1848820120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3348103750 0x7f3348103bc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3340009900 tx=0x7f334002a480 comp rx=0 tx=0).stop 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 -- 172.21.15.60:0/1848820120 shutdown_connections 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 --2- 172.21.15.60:0/1848820120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 0x7f334810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 --2- 172.21.15.60:0/1848820120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33481047e0 0x7f3348104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 --2- 172.21.15.60:0/1848820120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3348103750 0x7f3348103bc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 -- 172.21.15.60:0/1848820120 >> 172.21.15.60:0/1848820120 conn(0x7f33480ff0c0 msgr2=0x7f3348101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:04.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 -- 172.21.15.60:0/1848820120 shutdown_connections 2024-09-21T07:27:04.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.985+0000 7f334d97b640 1 -- 172.21.15.60:0/1848820120 wait complete. 2024-09-21T07:27:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 Processor -- start 2024-09-21T07:27:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 -- start start 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3348103750 0x7f334819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 0x7f334819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 0x7f334819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f334810f390 con 0x7f33481047e0 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f334810f210 con 0x7f3348105180 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f334d97b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f334810f510 con 0x7f3348103750 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f33467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 0x7f334819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f33467fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 0x7f334819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37440/0 (socket says 172.21.15.60:37440) 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.986+0000 7f33467fc640 1 -- 172.21.15.60:0/161199857 learned_addr learned my addr 172.21.15.60:0/161199857 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f3346ffd640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3348103750 0x7f334819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33477fe640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 0x7f334819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33467fc640 1 -- 172.21.15.60:0/161199857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3348103750 msgr2=0x7f334819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33467fc640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3348103750 0x7f334819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33467fc640 1 -- 172.21.15.60:0/161199857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 msgr2=0x7f334819b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33467fc640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 0x7f334819b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33467fc640 1 -- 172.21.15.60:0/161199857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334819ba00 con 0x7f33481047e0 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33477fe640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 0x7f334819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f3346ffd640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3348103750 0x7f334819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f33467fc640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 0x7f334819a6b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f333000e9f0 tx=0x7f333000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333000cd80 con 0x7f33481047e0 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334819bcf0 con 0x7f33481047e0 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33300054d0 con 0x7f33481047e0 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330010690 con 0x7f33481047e0 2024-09-21T07:27:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.987+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33481a23f0 con 0x7f33481047e0 2024-09-21T07:27:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.988+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334810a930 con 0x7f33481047e0 2024-09-21T07:27:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.990+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3330004e30 con 0x7f33481047e0 2024-09-21T07:27:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.991+0000 7f334c979640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f33340b6500 0x7f33340b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.991+0000 7f3346ffd640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f33340b6500 0x7f33340b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.991+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f33300e5df0 con 0x7f33481047e0 2024-09-21T07:27:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.991+0000 7f3346ffd640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f33340b6500 0x7f33340b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3340031440 tx=0x7f3340005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:04.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:04.994+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3330056710 con 0x7f33481047e0 2024-09-21T07:27:05.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:05.192+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3348063800 con 0x7f33340b6500 2024-09-21T07:27:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:05 smithi060 ceph-mon[31244]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:05 smithi060 ceph-mon[31244]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:05 smithi187 ceph-mon[34367]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:05 smithi187 ceph-mon[34367]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:05 smithi123 ceph-mon[34166]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:05 smithi123 ceph-mon[34166]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:07 smithi060 ceph-mon[31244]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:08.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:07 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/680244626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3a719ec-ef8e-4f38-902e-2aec93ed6ed1"} : dispatch 2024-09-21T07:27:08.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:07 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/680244626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3a719ec-ef8e-4f38-902e-2aec93ed6ed1"}]': finished 2024-09-21T07:27:08.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:07 smithi060 ceph-mon[31244]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T07:27:08.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:08 smithi187 ceph-mon[34367]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:08 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/680244626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3a719ec-ef8e-4f38-902e-2aec93ed6ed1"} : dispatch 2024-09-21T07:27:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:08 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/680244626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3a719ec-ef8e-4f38-902e-2aec93ed6ed1"}]': finished 2024-09-21T07:27:08.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:08 smithi187 ceph-mon[34367]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T07:27:08.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:08 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:08 smithi123 ceph-mon[34166]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:08 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/680244626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3a719ec-ef8e-4f38-902e-2aec93ed6ed1"} : dispatch 2024-09-21T07:27:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:08 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/680244626' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3a719ec-ef8e-4f38-902e-2aec93ed6ed1"}]': finished 2024-09-21T07:27:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:08 smithi123 ceph-mon[34166]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T07:27:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:08 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:09.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:09 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3577227936' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:09.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:09 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3577227936' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:09.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:09 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3577227936' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:10 smithi187 ceph-mon[34367]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:10.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:10 smithi123 ceph-mon[34166]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:10 smithi060 ceph-mon[31244]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:12 smithi187 ceph-mon[34367]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:12 smithi123 ceph-mon[34166]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:12 smithi060 ceph-mon[31244]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:14 smithi187 ceph-mon[34367]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:14.323 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:14 smithi060 ceph-mon[31244]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:14 smithi123 ceph-mon[34166]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:16 smithi187 ceph-mon[34367]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:27:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:16 smithi123 ceph-mon[34166]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:27:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:16 smithi060 ceph-mon[31244]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:27:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:17.244 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:17 smithi060 ceph-mon[31244]: Deploying daemon osd.0 on smithi060 2024-09-21T07:27:17.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:17 smithi123 ceph-mon[34166]: Deploying daemon osd.0 on smithi060 2024-09-21T07:27:17.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:17 smithi187 ceph-mon[34367]: Deploying daemon osd.0 on smithi060 2024-09-21T07:27:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:18 smithi123 ceph-mon[34166]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:18.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:18 smithi060 ceph-mon[31244]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:18 smithi187 ceph-mon[34367]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:20.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:20 smithi060 ceph-mon[31244]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:20 smithi123 ceph-mon[34166]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:20 smithi187 ceph-mon[34367]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:22 smithi123 ceph-mon[34166]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:22.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:22 smithi060 ceph-mon[31244]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:22.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:22.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:22.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:22 smithi187 ceph-mon[34367]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:24 smithi123 ceph-mon[34166]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:24 smithi060 ceph-mon[31244]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:24 smithi187 ceph-mon[34367]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:25.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.358+0000 7f334c979640 1 -- 172.21.15.60:0/161199857 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3348063800 con 0x7f33340b6500 2024-09-21T07:27:25.360 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 0 on host 'smithi060' 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f33340b6500 msgr2=0x7f33340b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f33340b6500 0x7f33340b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3340031440 tx=0x7f3340005d50 comp rx=0 tx=0).stop 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 msgr2=0x7f334819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 0x7f334819a6b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f333000e9f0 tx=0x7f333000edf0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 shutdown_connections 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f33340b6500 0x7f33340b8a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3348105180 0x7f334819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33481047e0 0x7f334819a6b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 --2- 172.21.15.60:0/161199857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3348103750 0x7f334819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 >> 172.21.15.60:0/161199857 conn(0x7f33480ff0c0 msgr2=0x7f3348107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 shutdown_connections 2024-09-21T07:27:25.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:27:25.361+0000 7f334d97b640 1 -- 172.21.15.60:0/161199857 wait complete. 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:25.952 DEBUG:teuthology.orchestra.run.smithi060:osd.0> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T07:27:25.954 INFO:tasks.cephadm:Deploying osd.1 on smithi123 with /dev/vg_nvme/lv_4... 2024-09-21T07:27:25.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:27:26.229 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:27:27.653 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:27 smithi060 ceph-mon[31244]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:27.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:27 smithi123 ceph-mon[34166]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:28.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:27 smithi187 ceph-mon[34367]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:28.122 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:27:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0[46890]: 2024-09-21T07:27:27.712+0000 7f77256cf640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:27:28.590 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:27:28.617 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-09-21T07:27:28.813 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:28 smithi060 ceph-mon[31244]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:27:28.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:28 smithi123 ceph-mon[34166]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:27:28.864 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:27:29.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:28 smithi187 ceph-mon[34367]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:27:29.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 -- 172.21.15.123:0/2389769676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 msgr2=0x7fecfc108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 --2- 172.21.15.123:0/2389769676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc108d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecec009900 tx=0x7fecec02a410 comp rx=0 tx=0).stop 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 -- 172.21.15.123:0/2389769676 shutdown_connections 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 --2- 172.21.15.123:0/2389769676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 0x7fecfc10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 --2- 172.21.15.123:0/2389769676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc108d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 --2- 172.21.15.123:0/2389769676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 0x7fecfc101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 -- 172.21.15.123:0/2389769676 >> 172.21.15.123:0/2389769676 conn(0x7fecfc0fd770 msgr2=0x7fecfc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 -- 172.21.15.123:0/2389769676 shutdown_connections 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.301+0000 7fed02ade640 1 -- 172.21.15.123:0/2389769676 wait complete. 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 Processor -- start 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 -- start start 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 0x7fecfc199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:29.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 0x7fecfc19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc10f380 con 0x7fecfc109470 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc10f200 con 0x7fecfc102530 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed02ade640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc10f500 con 0x7fecfc101b00 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33748/0 (socket says 172.21.15.123:33748) 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 -- 172.21.15.123:0/2015706106 learned_addr learned my addr 172.21.15.123:0/2015706106 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed0087a640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 0x7fecfc199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed0107b640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 0x7fecfc19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 -- 172.21.15.123:0/2015706106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 msgr2=0x7fecfc199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 0x7fecfc199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 -- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 msgr2=0x7fecfc19b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:29.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 0x7fecfc19b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fecf3fff640 1 -- 172.21.15.123:0/2015706106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc19ba00 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed0087a640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 0x7fecfc199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.302+0000 7fed0107b640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 0x7fecfc19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.303+0000 7fecf3fff640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc19a640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecec006010 tx=0x7fecec004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.303+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec03f030 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.303+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecec003cb0 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.303+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc19bc90 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.303+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec035070 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.303+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc1a23f0 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.304+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc0ff290 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.306+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fecec042030 con 0x7fecfc102530 2024-09-21T07:27:29.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.307+0000 7fecf1ffb640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fece40b6500 0x7fece40b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:29.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.307+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7fecec106400 con 0x7fecfc102530 2024-09-21T07:27:29.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.307+0000 7fed0087a640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fece40b6500 0x7fece40b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:29.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.308+0000 7fed0087a640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fece40b6500 0x7fece40b8a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecf80058c0 tx=0x7fecf8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:29.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.310+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fecec0ce890 con 0x7fecfc102530 2024-09-21T07:27:29.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:29.498+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fecfc063800 con 0x7fece40b6500 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi060 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:27:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:29.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:29.872 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0[46890]: 2024-09-21T07:27:29.601+0000 7f7721651640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:27:29.872 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0[46890]: 2024-09-21T07:27:29.605+0000 7f771d44f640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi060 2024-09-21T07:27:29.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:29.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi060 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:30.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:30.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:30.731 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:30 smithi123 ceph-mon[34166]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:30.732 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:30 smithi123 ceph-mon[34166]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:27:30.732 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:30 smithi123 ceph-mon[34166]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:27:30.732 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:30.732 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:30.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:30 smithi060 ceph-mon[31244]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:30.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:30 smithi060 ceph-mon[31244]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:27:30.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:30 smithi060 ceph-mon[31244]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:27:30.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:30.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:31.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:30 smithi187 ceph-mon[34367]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:31.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:30 smithi187 ceph-mon[34367]: from='osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:27:31.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:30 smithi187 ceph-mon[34367]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:27:31.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:31.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:31.859 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:27:31.859 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:27:31.859 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:31.859 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] boot 2024-09-21T07:27:31.859 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T07:27:31.860 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:31.860 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/3544117105' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"} : dispatch 2024-09-21T07:27:31.860 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"} : dispatch 2024-09-21T07:27:31.860 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"}]': finished 2024-09-21T07:27:31.860 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: osdmap e9: 2 total, 1 up, 2 in 2024-09-21T07:27:31.860 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:31.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] boot 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/3544117105' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"} : dispatch 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"} : dispatch 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"}]': finished 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: osdmap e9: 2 total, 1 up, 2 in 2024-09-21T07:27:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: osd.0 [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] boot 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/3544117105' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"} : dispatch 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"} : dispatch 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a864067d-8d15-4d06-9ff5-0750ec06bd7b"}]': finished 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: osdmap e9: 2 total, 1 up, 2 in 2024-09-21T07:27:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:33.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:32 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/2819102012' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:33.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:32 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/2819102012' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:33.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:32 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/2819102012' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:34.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:33 smithi187 ceph-mon[34367]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:34.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:33 smithi123 ceph-mon[34166]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:34.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:33 smithi060 ceph-mon[31244]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:36.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:35 smithi187 ceph-mon[34367]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:36.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:35 smithi123 ceph-mon[34166]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:36.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:35 smithi060 ceph-mon[31244]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:37.956 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:37 smithi123 ceph-mon[34166]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:37 smithi187 ceph-mon[34367]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:38.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:37 smithi060 ceph-mon[31244]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:40.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:39 smithi187 ceph-mon[34367]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:40.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:39 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:27:40.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:39 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:40.055 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:39 smithi123 ceph-mon[34166]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:40.056 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:39 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:27:40.056 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:39 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:40.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:39 smithi060 ceph-mon[31244]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:40.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:39 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:27:40.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:39 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:41.015 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:40 smithi123 ceph-mon[34166]: Deploying daemon osd.1 on smithi123 2024-09-21T07:27:41.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:40 smithi187 ceph-mon[34367]: Deploying daemon osd.1 on smithi123 2024-09-21T07:27:41.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:40 smithi060 ceph-mon[31244]: Deploying daemon osd.1 on smithi123 2024-09-21T07:27:42.011 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:41 smithi123 ceph-mon[34166]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:42.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:41 smithi187 ceph-mon[34367]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:42.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:41 smithi060 ceph-mon[31244]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:44.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:43 smithi187 ceph-mon[34367]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:44.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:43 smithi123 ceph-mon[34166]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:43 smithi060 ceph-mon[31244]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:46.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:45 smithi187 ceph-mon[34367]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:46.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:45 smithi123 ceph-mon[34166]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:46.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:46.084 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:46.085 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:46.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:45 smithi060 ceph-mon[31244]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:46.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:46.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:46.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:47.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:47 smithi123 ceph-mon[34166]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:48.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:47 smithi187 ceph-mon[34367]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:47 smithi060 ceph-mon[31244]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:49.129 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.130 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.130 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:49.130 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:49.130 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:49.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:49.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:49.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:49.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.721+0000 7fecf1ffb640 1 -- 172.21.15.123:0/2015706106 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fecfc063800 con 0x7fece40b6500 2024-09-21T07:27:49.724 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 1 on host 'smithi123' 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fece40b6500 msgr2=0x7fece40b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fece40b6500 0x7fece40b8a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecf80058c0 tx=0x7fecf8005850 comp rx=0 tx=0).stop 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 msgr2=0x7fecfc19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc19a640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fecec006010 tx=0x7fecec004340 comp rx=0 tx=0).stop 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 shutdown_connections 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fece40b6500 0x7fece40b8a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecfc109470 0x7fecfc19b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecfc102530 0x7fecfc19a640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 --2- 172.21.15.123:0/2015706106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecfc101b00 0x7fecfc199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 >> 172.21.15.123:0/2015706106 conn(0x7fecfc0fd770 msgr2=0x7fecfc10a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 shutdown_connections 2024-09-21T07:27:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:27:49.724+0000 7fed02ade640 1 -- 172.21.15.123:0/2015706106 wait complete. 2024-09-21T07:27:50.008 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:49 smithi123 ceph-mon[34166]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:50.008 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:50.008 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:50.008 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:49 smithi187 ceph-mon[34367]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:50.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:50.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:50.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:50.316 DEBUG:teuthology.orchestra.run.smithi123:osd.1> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T07:27:50.318 INFO:tasks.cephadm:Deploying osd.2 on smithi187 with /dev/vg_nvme/lv_4... 2024-09-21T07:27:50.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:27:50.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:49 smithi060 ceph-mon[31244]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:50.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:27:50.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:50.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:50.570 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:27:51.988 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:51 smithi187 ceph-mon[34367]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:51.988 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:51 smithi187 ceph-mon[34367]: from='osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:27:51.988 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:51 smithi187 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:27:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:51 smithi123 ceph-mon[34166]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:51 smithi123 ceph-mon[34166]: from='osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:27:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:51 smithi123 ceph-mon[34166]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:27:52.099 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:27:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1[38079]: 2024-09-21T07:27:51.769+0000 7fc7c23c8640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:27:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:51 smithi060 ceph-mon[31244]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:52.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:51 smithi060 ceph-mon[31244]: from='osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:27:52.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:51 smithi060 ceph-mon[31244]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:27:52.996 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:52 smithi123 ceph-mon[34166]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:27:52.996 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:52 smithi123 ceph-mon[34166]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T07:27:52.996 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:52 smithi123 ceph-mon[34166]: from='osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:27:52.997 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:52 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:52.997 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:52 smithi123 ceph-mon[34166]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:27:52.997 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:52 smithi123 ceph-mon[34166]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:27:53.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:52 smithi187 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:27:53.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:52 smithi187 ceph-mon[34367]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T07:27:53.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:52 smithi187 ceph-mon[34367]: from='osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:27:53.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:52 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:53.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:52 smithi187 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:27:53.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:52 smithi187 ceph-mon[34367]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:27:53.244 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:27:53.275 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_4 2024-09-21T07:27:53.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:52 smithi060 ceph-mon[31244]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:27:53.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:52 smithi060 ceph-mon[31244]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T07:27:53.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:52 smithi060 ceph-mon[31244]: from='osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:27:53.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:52 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:53.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:52 smithi060 ceph-mon[31244]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:27:53.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:52 smithi060 ceph-mon[31244]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:27:53.515 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:27:53.995 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 -- 172.21.15.187:0/1039607760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e381036e0 msgr2=0x7f9e38103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.995 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 --2- 172.21.15.187:0/1039607760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e381036e0 0x7f9e38103af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009900 tx=0x7f9e2802a480 comp rx=0 tx=0).stop 2024-09-21T07:27:53.995 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 -- 172.21.15.187:0/1039607760 shutdown_connections 2024-09-21T07:27:53.995 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 --2- 172.21.15.187:0/1039607760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e38104080 0x7f9e3810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.995 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 --2- 172.21.15.187:0/1039607760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e381036e0 0x7f9e38103af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.995 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 --2- 172.21.15.187:0/1039607760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e38102650 0x7f9e38102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 -- 172.21.15.187:0/1039607760 >> 172.21.15.187:0/1039607760 conn(0x7f9e380fdfe0 msgr2=0x7f9e38100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 -- 172.21.15.187:0/1039607760 shutdown_connections 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.987+0000 7f9e40399640 1 -- 172.21.15.187:0/1039607760 wait complete. 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 Processor -- start 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 -- start start 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 0x7f9e3819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e381036e0 0x7f9e3819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e38104080 0x7f9e3819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3810e2a0 con 0x7f9e381036e0 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3810e120 con 0x7f9e38104080 2024-09-21T07:27:53.996 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e40399640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3810e420 con 0x7f9e38102650 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 0x7f9e3819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 0x7f9e3819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:37554/0 (socket says 172.21.15.187:37554) 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 -- 172.21.15.187:0/2061114150 learned_addr learned my addr 172.21.15.187:0/2061114150 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3d934640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e381036e0 0x7f9e3819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e936640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e38104080 0x7f9e3819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 -- 172.21.15.187:0/2061114150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e38104080 msgr2=0x7f9e3819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e38104080 0x7f9e3819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 -- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e381036e0 msgr2=0x7f9e3819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e381036e0 0x7f9e3819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.988+0000 7f9e3e135640 1 -- 172.21.15.187:0/2061114150 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3819ba50 con 0x7f9e38102650 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.989+0000 7f9e3e135640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 0x7f9e3819a020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400d770 tx=0x7f9e3400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.989+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34017070 con 0x7f9e38102650 2024-09-21T07:27:53.997 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.989+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e340054d0 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.989+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3819bd40 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.989+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34004c30 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.989+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e381a2440 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.990+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e381a2610 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.991+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f9e34004dd0 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.992+0000 7f9e2f7fe640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9e240b6500 0x7f9e240b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.993+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f9e340e58f0 con 0x7f9e38102650 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.993+0000 7f9e3d934640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9e240b6500 0x7f9e240b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.993+0000 7f9e3d934640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9e240b6500 0x7f9e240b8a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e28031440 tx=0x7f9e280314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:27:53.998 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:53.996+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e340adad0 con 0x7f9e38102650 2024-09-21T07:27:54.099 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1[38079]: 2024-09-21T07:27:53.826+0000 7fc7beb5f640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:27:54.099 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1[38079]: 2024-09-21T07:27:53.953+0000 7fc7b6140640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:27:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:27:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi123 2024-09-21T07:27:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='osd.1 ' entity='osd.1' 2024-09-21T07:27:54.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.187 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:27:54.185+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9e3806c2b0 con 0x7f9e240b6500 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi123 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.187 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='osd.1 ' entity='osd.1' 2024-09-21T07:27:54.188 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi123 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi123 to 17088M 2024-09-21T07:27:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:54.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:27:54.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:27:54.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='osd.1 ' entity='osd.1' 2024-09-21T07:27:54.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:55.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:54 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:55.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:54 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:27:55.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:56.192 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:55 smithi187 ceph-mon[34367]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:56.192 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:55 smithi187 ceph-mon[34367]: osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] boot 2024-09-21T07:27:56.192 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:55 smithi187 ceph-mon[34367]: osdmap e12: 2 total, 2 up, 2 in 2024-09-21T07:27:56.192 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:55 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:56.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:55 smithi060 ceph-mon[31244]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:56.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:55 smithi060 ceph-mon[31244]: osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] boot 2024-09-21T07:27:56.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:55 smithi060 ceph-mon[31244]: osdmap e12: 2 total, 2 up, 2 in 2024-09-21T07:27:56.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:55 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:55 smithi123 ceph-mon[34166]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:27:56.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:55 smithi123 ceph-mon[34166]: osd.1 [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] boot 2024-09-21T07:27:56.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:55 smithi123 ceph-mon[34166]: osdmap e12: 2 total, 2 up, 2 in 2024-09-21T07:27:56.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:55 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:27:57.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:56 smithi123 ceph-mon[34166]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T07:27:57.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:56 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/3977474844' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"} : dispatch 2024-09-21T07:27:57.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:56 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"} : dispatch 2024-09-21T07:27:57.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:56 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"}]': finished 2024-09-21T07:27:57.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:56 smithi123 ceph-mon[34166]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T07:27:57.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:27:57.144 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:56 smithi187 ceph-mon[34367]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T07:27:57.144 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:56 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/3977474844' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"} : dispatch 2024-09-21T07:27:57.144 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:56 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"} : dispatch 2024-09-21T07:27:57.144 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:56 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"}]': finished 2024-09-21T07:27:57.144 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:56 smithi187 ceph-mon[34367]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T07:27:57.144 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:27:57.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:56 smithi060 ceph-mon[31244]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T07:27:57.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:56 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/3977474844' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"} : dispatch 2024-09-21T07:27:57.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:56 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"} : dispatch 2024-09-21T07:27:57.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:56 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9eb477e9-1e45-45e6-9146-150a9a015d1c"}]': finished 2024-09-21T07:27:57.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:56 smithi060 ceph-mon[31244]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T07:27:57.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:27:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:57 smithi187 ceph-mon[34367]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:27:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:57 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/1976490072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:58.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:57 smithi123 ceph-mon[34166]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:27:58.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:57 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/1976490072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:27:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:57 smithi060 ceph-mon[31244]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:27:58.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:57 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/1976490072' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:27:59 smithi187 ceph-mon[34367]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:27:59 smithi123 ceph-mon[34166]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:27:59 smithi060 ceph-mon[31244]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:01 smithi187 ceph-mon[34367]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:01 smithi123 ceph-mon[34166]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:01 smithi060 ceph-mon[31244]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:04.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:03 smithi187 ceph-mon[34367]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:03 smithi123 ceph-mon[34166]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:03 smithi060 ceph-mon[31244]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:05 smithi187 ceph-mon[34367]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:28:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:05 smithi187 ceph-mon[34367]: Deploying daemon osd.2 on smithi187 2024-09-21T07:28:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:05 smithi123 ceph-mon[34166]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:28:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:05 smithi123 ceph-mon[34166]: Deploying daemon osd.2 on smithi187 2024-09-21T07:28:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:05 smithi060 ceph-mon[31244]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:28:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:05 smithi060 ceph-mon[31244]: Deploying daemon osd.2 on smithi187 2024-09-21T07:28:08.208 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:07 smithi187 ceph-mon[34367]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:07 smithi123 ceph-mon[34166]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:07 smithi060 ceph-mon[31244]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:09 smithi187 ceph-mon[34367]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:10.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:09 smithi123 ceph-mon[34166]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:09 smithi060 ceph-mon[31244]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:12.100 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:11 smithi187 ceph-mon[34367]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:12.330 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:12.330 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:12.330 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:11 smithi123 ceph-mon[34166]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:12.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:12.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:12.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:11 smithi060 ceph-mon[31244]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:13 smithi187 ceph-mon[34367]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:14.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:13 smithi123 ceph-mon[34166]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:14.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:13 smithi060 ceph-mon[31244]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:15.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:15.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:15.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:15.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:15.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:15.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:15.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:15.620 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.618+0000 7f9e2f7fe640 1 -- 172.21.15.187:0/2061114150 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9e3806c2b0 con 0x7f9e240b6500 2024-09-21T07:28:15.621 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 2 on host 'smithi187' 2024-09-21T07:28:15.623 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9e240b6500 msgr2=0x7f9e240b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:15.623 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9e240b6500 0x7f9e240b8a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e28031440 tx=0x7f9e280314a0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.623 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 msgr2=0x7f9e3819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:15.623 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 0x7f9e3819a020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400d770 tx=0x7f9e3400dc30 comp rx=0 tx=0).stop 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 shutdown_connections 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9e240b6500 0x7f9e240b8a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e38104080 0x7f9e3819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e381036e0 0x7f9e3819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.621+0000 7f9e40399640 1 --2- 172.21.15.187:0/2061114150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e38102650 0x7f9e3819a020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.622+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 >> 172.21.15.187:0/2061114150 conn(0x7f9e380fdfe0 msgr2=0x7f9e3806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.622+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 shutdown_connections 2024-09-21T07:28:15.624 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:28:15.622+0000 7f9e40399640 1 -- 172.21.15.187:0/2061114150 wait complete. 2024-09-21T07:28:16.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:15 smithi187 ceph-mon[34367]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:16.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:16.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:16.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:15 smithi123 ceph-mon[34166]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:16.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:16.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:16.267 DEBUG:teuthology.orchestra.run.smithi187:osd.2> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T07:28:16.269 INFO:tasks.cephadm:Deploying osd.3 on smithi060 with /dev/vg_nvme/lv_3... 2024-09-21T07:28:16.269 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:28:16.298 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:15 smithi060 ceph-mon[31244]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:16.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:16.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:16.299 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:28:17.658 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2[38734]: 2024-09-21T07:28:17.425+0000 7fa5c4ade640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:28:18.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:18 smithi060 ceph-mon[31244]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:18.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:18 smithi060 ceph-mon[31244]: from='osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:28:18.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:18 smithi060 ceph-mon[31244]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:28:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:18 smithi187 ceph-mon[34367]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:18 smithi187 ceph-mon[34367]: from='osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:28:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:18 smithi187 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:28:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:18 smithi123 ceph-mon[34166]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:18 smithi123 ceph-mon[34166]: from='osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:28:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:18 smithi123 ceph-mon[34166]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:28:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:28:18.964 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-09-21T07:28:19.276 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: from='osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:28:19.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: from='osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:28:19.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:19.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: from='osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:28:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:19.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.748+0000 7efcc80a8640 1 -- 172.21.15.60:0/3583410507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0102650 msgr2=0x7efcc0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.748+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3583410507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0102650 0x7efcc0102ac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009900 tx=0x7efcbc02a480 comp rx=0 tx=0).stop 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.748+0000 7efcc80a8640 1 -- 172.21.15.60:0/3583410507 shutdown_connections 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.748+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3583410507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0104080 0x7efcc010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3583410507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc01036e0 0x7efcc0103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3583410507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0102650 0x7efcc0102ac0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 -- 172.21.15.60:0/3583410507 >> 172.21.15.60:0/3583410507 conn(0x7efcc00fdfe0 msgr2=0x7efcc0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 -- 172.21.15.60:0/3583410507 shutdown_connections 2024-09-21T07:28:19.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 -- 172.21.15.60:0/3583410507 wait complete. 2024-09-21T07:28:19.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 Processor -- start 2024-09-21T07:28:19.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.749+0000 7efcc80a8640 1 -- start start 2024-09-21T07:28:19.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc80a8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 0x7efcc0198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc80a8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc01036e0 0x7efcc0199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc80a8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 0x7efcc019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc80a8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcc010e310 con 0x7efcc0104080 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc80a8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efcc010e190 con 0x7efcc01036e0 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc80a8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efcc010e490 con 0x7efcc0102650 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 0x7efcc019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc5e44640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 0x7efcc0198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc5e44640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 0x7efcc0198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.60:45102/0 (socket says 172.21.15.60:45102) 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 0x7efcc019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59278/0 (socket says 172.21.15.60:59278) 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc5e44640 1 -- 172.21.15.60:0/3027018039 learned_addr learned my addr 172.21.15.60:0/3027018039 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc5643640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc01036e0 0x7efcc0199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 -- 172.21.15.60:0/3027018039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 msgr2=0x7efcc0198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 0x7efcc0198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 -- 172.21.15.60:0/3027018039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc01036e0 msgr2=0x7efcc0199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc01036e0 0x7efcc0199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 -- 172.21.15.60:0/3027018039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc019a940 con 0x7efcc0104080 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc5e44640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 0x7efcc0198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.750+0000 7efcc6645640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 0x7efcc019a120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcb800e940 tx=0x7efcb800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.751+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8004d20 con 0x7efcc0104080 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.751+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcb8005020 con 0x7efcc0104080 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.751+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc019ac30 con 0x7efcc0104080 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.751+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb80116d0 con 0x7efcc0104080 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.751+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc01a1330 con 0x7efcc0104080 2024-09-21T07:28:19.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.752+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc0109830 con 0x7efcc0104080 2024-09-21T07:28:19.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.753+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7efcb800ca60 con 0x7efcc0104080 2024-09-21T07:28:19.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.754+0000 7efcb6ffd640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcac0b6580 0x7efcac0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:19.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.754+0000 7efcc5e44640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcac0b6580 0x7efcac0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:19.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.754+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7efcb80e5f80 con 0x7efcc0104080 2024-09-21T07:28:19.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.755+0000 7efcc5e44640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcac0b6580 0x7efcac0b8a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efcbc032fd0 tx=0x7efcbc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:19.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.757+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcb8016030 con 0x7efcc0104080 2024-09-21T07:28:19.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:19.959+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7efcc0063800 con 0x7efcac0b6580 2024-09-21T07:28:20.018 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2[38734]: 2024-09-21T07:28:19.902+0000 7fa5c0a60640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:28:20.269 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2[38734]: 2024-09-21T07:28:20.029+0000 7fa5b8856640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi187 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi187 to 17088M 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:20.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='osd.2 ' entity='osd.2' 2024-09-21T07:28:20.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:28:20.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:28:20.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:20.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi187 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi187 to 17088M 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='osd.2 ' entity='osd.2' 2024-09-21T07:28:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:28:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:28:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi187 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi187 to 17088M 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:20.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:20.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='osd.2 ' entity='osd.2' 2024-09-21T07:28:20.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:28:20.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:28:20.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:20.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:21.293 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:21 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:28:21.294 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:21 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:28:21.294 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:21 smithi060 ceph-mon[31244]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:28:21.294 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:21.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:21 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:28:21.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:21 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:28:21.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:21 smithi123 ceph-mon[34166]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:28:21.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:21.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:21 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:28:21.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:21 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:28:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:21 smithi187 ceph-mon[34367]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:28:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:22 smithi123 ceph-mon[34166]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:22 smithi123 ceph-mon[34166]: osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] boot 2024-09-21T07:28:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:22 smithi123 ceph-mon[34166]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T07:28:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:22.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:22 smithi060 ceph-mon[31244]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:22.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:22 smithi060 ceph-mon[31244]: osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] boot 2024-09-21T07:28:22.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:22 smithi060 ceph-mon[31244]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T07:28:22.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:22.523 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:22 smithi187 ceph-mon[34367]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:28:22.523 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:22 smithi187 ceph-mon[34367]: osd.2 [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] boot 2024-09-21T07:28:22.523 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:22 smithi187 ceph-mon[34367]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T07:28:22.523 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:28:23.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:28:23.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2655927940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "74305a81-d848-48b3-936b-ead6ec6cbad8"} : dispatch 2024-09-21T07:28:23.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2655927940' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74305a81-d848-48b3-936b-ead6ec6cbad8"}]': finished 2024-09-21T07:28:23.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T07:28:23.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:23.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:28:23.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4052339348' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2655927940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "74305a81-d848-48b3-936b-ead6ec6cbad8"} : dispatch 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2655927940' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74305a81-d848-48b3-936b-ead6ec6cbad8"}]': finished 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:28:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4052339348' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:23.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:28:23.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2655927940' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "74305a81-d848-48b3-936b-ead6ec6cbad8"} : dispatch 2024-09-21T07:28:23.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2655927940' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "74305a81-d848-48b3-936b-ead6ec6cbad8"}]': finished 2024-09-21T07:28:23.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: osdmap e19: 4 total, 3 up, 4 in 2024-09-21T07:28:23.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:23.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:28:23.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4052339348' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 ceph-mon[34166]: pgmap v94: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:28:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 ceph-mon[34166]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T07:28:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:28:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 ceph-mon[31244]: pgmap v94: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:28:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 ceph-mon[31244]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T07:28:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:28:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 ceph-mon[34367]: pgmap v94: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:28:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 ceph-mon[34367]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T07:28:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:28:24.764 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42148]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:28:24.764 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42148]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.764 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.764 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42148]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:24.764 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42141]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:28:24.764 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42141]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.764 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.765 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42141]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:24.765 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42145]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:28:24.765 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42145]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.765 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.765 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42145]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51786]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51786]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51786]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51789]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51789]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51789]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51779]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51779]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51779]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51782]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51782]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:24.873 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 07:28:24 smithi060 sudo[51782]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:25.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42408]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42408]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42408]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42411]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42411]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:25.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42411]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:25.020 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42402]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:28:25.020 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42402]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:25.020 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:25.021 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42402]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:25.021 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42405]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:28:25.021 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42405]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:25.021 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:25.021 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 07:28:24 smithi187 sudo[42405]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:25.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42151]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:28:25.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42151]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:28:25.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:28:25.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:24 smithi123 sudo[42151]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:28:25.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:25.594+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efcb80a9ab0 con 0x7efcc0104080 2024-09-21T07:28:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:28:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:28:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:25.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.773 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.773 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:25 smithi187 ceph-mon[34367]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:28:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:28:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:25 smithi123 ceph-mon[34166]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:28:25.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:25 smithi060 ceph-mon[31244]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:28:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:26 smithi187 ceph-mon[34367]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:28:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:26 smithi187 ceph-mon[34367]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:28:26.772 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:26 smithi060 ceph-mon[31244]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:28:26.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:26.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:26 smithi060 ceph-mon[31244]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:28:26.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:26 smithi123 ceph-mon[34166]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:28:26.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:26.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:26 smithi123 ceph-mon[34166]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:28:27.711 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:27 smithi060 ceph-mon[31244]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:27.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:27 smithi187 ceph-mon[34367]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:27.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:27 smithi123 ceph-mon[34166]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:29.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:29 smithi060 ceph-mon[31244]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:29.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:29 smithi123 ceph-mon[34166]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:30.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:29 smithi187 ceph-mon[34367]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:30.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:28:31.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:28:31.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:28:31.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:31 smithi060 ceph-mon[31244]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:31.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:31 smithi060 ceph-mon[31244]: Deploying daemon osd.3 on smithi060 2024-09-21T07:28:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:31 smithi187 ceph-mon[34367]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:31 smithi187 ceph-mon[34367]: Deploying daemon osd.3 on smithi060 2024-09-21T07:28:32.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:31 smithi123 ceph-mon[34166]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:32.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:32.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:31 smithi123 ceph-mon[34166]: Deploying daemon osd.3 on smithi060 2024-09-21T07:28:33.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:33 smithi060 ceph-mon[31244]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:34.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:33 smithi187 ceph-mon[34367]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:34.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:33 smithi123 ceph-mon[34166]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:35.791 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:35 smithi060 ceph-mon[31244]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:36.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:35 smithi187 ceph-mon[34367]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:36.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:35 smithi123 ceph-mon[34166]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:37.718 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:37 smithi060 ceph-mon[31244]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:37.718 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:37.718 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:37.718 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:37 smithi187 ceph-mon[34367]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:38.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:37 smithi123 ceph-mon[34166]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:38.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:38.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:38.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:39.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:39 smithi060 ceph-mon[31244]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:40.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:39 smithi187 ceph-mon[34367]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:40.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:39 smithi123 ceph-mon[34166]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:40.881 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:40.881 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:40.882 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:40.882 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:40.882 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:40.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.923+0000 7efcb6ffd640 1 -- 172.21.15.60:0/3027018039 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efcc0063800 con 0x7efcac0b6580 2024-09-21T07:28:40.925 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 3 on host 'smithi060' 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcac0b6580 msgr2=0x7efcac0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcac0b6580 0x7efcac0b8a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efcbc032fd0 tx=0x7efcbc0314a0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 msgr2=0x7efcc019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 0x7efcc019a120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcb800e940 tx=0x7efcb800ed40 comp rx=0 tx=0).stop 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 shutdown_connections 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcac0b6580 0x7efcac0b8a90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc0104080 0x7efcc019a120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc01036e0 0x7efcc0199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 --2- 172.21.15.60:0/3027018039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc0102650 0x7efcc0198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:40.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 >> 172.21.15.60:0/3027018039 conn(0x7efcc00fdfe0 msgr2=0x7efcc0106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:40.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 shutdown_connections 2024-09-21T07:28:40.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:28:40.926+0000 7efcc80a8640 1 -- 172.21.15.60:0/3027018039 wait complete. 2024-09-21T07:28:41.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:41.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:41.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:41.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:41.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.522 DEBUG:teuthology.orchestra.run.smithi060:osd.3> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T07:28:41.525 INFO:tasks.cephadm:Deploying osd.4 on smithi123 with /dev/vg_nvme/lv_3... 2024-09-21T07:28:41.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:28:41.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:41 smithi060 ceph-mon[31244]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:41.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:41 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:41.745 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:41 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.746 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:41 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:28:41.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:41 smithi123 ceph-mon[34166]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:41 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:41 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:41 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:42.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:41 smithi187 ceph-mon[34367]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:42.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:41 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:28:42.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:41 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:42.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:41 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:43.372 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 07:28:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3[53326]: 2024-09-21T07:28:43.049+0000 7fda54fb5640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:28:44.015 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:43 smithi060 ceph-mon[31244]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:44.015 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:43 smithi060 ceph-mon[31244]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:28:44.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:43 smithi187 ceph-mon[34367]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:44.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:43 smithi187 ceph-mon[34367]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:28:44.080 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:43 smithi123 ceph-mon[34166]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:44.080 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:43 smithi123 ceph-mon[34166]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:28:44.083 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:28:44.109 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-09-21T07:28:44.358 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:28:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 -- 172.21.15.123:0/2063236692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348103780 msgr2=0x7f6348103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 --2- 172.21.15.123:0/2063236692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348103780 0x7f6348103b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6334009900 tx=0x7f633402a480 comp rx=0 tx=0).stop 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 -- 172.21.15.123:0/2063236692 shutdown_connections 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 --2- 172.21.15.123:0/2063236692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6348104120 0x7f634810aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 --2- 172.21.15.123:0/2063236692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348103780 0x7f6348103b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 --2- 172.21.15.123:0/2063236692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63481026f0 0x7f6348102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 -- 172.21.15.123:0/2063236692 >> 172.21.15.123:0/2063236692 conn(0x7f63480fe080 msgr2=0x7f6348100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 -- 172.21.15.123:0/2063236692 shutdown_connections 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.826+0000 7f634f04e640 1 -- 172.21.15.123:0/2063236692 wait complete. 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 Processor -- start 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 -- start start 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63481026f0 0x7f6348199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6348103780 0x7f634819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 0x7f634819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f634810e2d0 con 0x7f63481026f0 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f634810e150 con 0x7f6348104120 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634f04e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f634810e450 con 0x7f6348103780 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 0x7f634819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 0x7f634819b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51340/0 (socket says 172.21.15.123:51340) 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 -- 172.21.15.123:0/335992229 learned_addr learned my addr 172.21.15.123:0/335992229 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634cdea640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63481026f0 0x7f6348199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f6347fff640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6348103780 0x7f634819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 -- 172.21.15.123:0/335992229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6348103780 msgr2=0x7f634819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6348103780 0x7f634819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 -- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63481026f0 msgr2=0x7f6348199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63481026f0 0x7f6348199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634d5eb640 1 -- 172.21.15.123:0/335992229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634819ba00 con 0x7f6348104120 2024-09-21T07:28:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.827+0000 7f634cdea640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63481026f0 0x7f6348199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.828+0000 7f634d5eb640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 0x7f634819b1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f634000eb10 tx=0x7f634000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.828+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340004b20 con 0x7f6348104120 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.828+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634819bcf0 con 0x7f6348104120 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.828+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6340004cc0 con 0x7f6348104120 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.828+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340010670 con 0x7f6348104120 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.828+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63481a23f0 con 0x7f6348104120 2024-09-21T07:28:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.829+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63481a25c0 con 0x7f6348104120 2024-09-21T07:28:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.830+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6340005020 con 0x7f6348104120 2024-09-21T07:28:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.831+0000 7f6345ffb640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f63380b6510 0x7f63380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:28:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.831+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f63400e6570 con 0x7f6348104120 2024-09-21T07:28:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.831+0000 7f634cdea640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f63380b6510 0x7f63380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:28:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.832+0000 7f634cdea640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f63380b6510 0x7f63380b8a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f633c009fc0 tx=0x7f633c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:28:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:44.836+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63400ae140 con 0x7f6348104120 2024-09-21T07:28:45.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:45.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:44 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:28:45.030+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f634806bf30 con 0x7f63380b6510 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:45.034 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.035 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:45.035 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:45.035 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:44 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:45.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:28:45.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:45.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:28:45.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:44 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:28:45.872 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3[53326]: 2024-09-21T07:28:45.447+0000 7fda50f37640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:28:45.872 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3[53326]: 2024-09-21T07:28:45.454+0000 7fda48d2d640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:28:45.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi060 2024-09-21T07:28:45.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-21T07:28:45.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:45.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:28:45.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:28:45.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] boot 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:28:45.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:46.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi060 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:46.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' 2024-09-21T07:28:46.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] boot 2024-09-21T07:28:46.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:28:46.021 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi060 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:28:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:28:46.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:28:46.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:46.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740]' entity='osd.3' 2024-09-21T07:28:46.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: osd.3 [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] boot 2024-09-21T07:28:46.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:28:46.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:28:47.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:46 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:28:47.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:46 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:28:47.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:46 smithi187 ceph-mon[34367]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:28:47.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:46 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:28:47.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:46 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:28:47.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:46 smithi123 ceph-mon[34166]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:28:47.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:46 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:28:47.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:46 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:28:47.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:46 smithi060 ceph-mon[31244]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:28:47.939 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:47 smithi187 ceph-mon[34367]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:47.939 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:47 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/3397650347' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"} : dispatch 2024-09-21T07:28:47.939 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:47 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"} : dispatch 2024-09-21T07:28:47.939 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:47 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"}]': finished 2024-09-21T07:28:47.939 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:47 smithi187 ceph-mon[34367]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:28:47.939 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:47 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:28:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:47 smithi123 ceph-mon[34166]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:47 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/3397650347' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"} : dispatch 2024-09-21T07:28:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:47 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"} : dispatch 2024-09-21T07:28:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:47 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"}]': finished 2024-09-21T07:28:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:47 smithi123 ceph-mon[34166]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:28:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:47 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:28:48.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:47 smithi060 ceph-mon[31244]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:48.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:47 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/3397650347' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"} : dispatch 2024-09-21T07:28:48.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:47 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"} : dispatch 2024-09-21T07:28:48.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:47 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7c4c148-9290-45d8-a044-058f80bf0492"}]': finished 2024-09-21T07:28:48.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:47 smithi060 ceph-mon[31244]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:28:48.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:47 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:28:49.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:48 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/4184536681' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:49.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:48 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/4184536681' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:49.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:48 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/4184536681' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:28:50.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:49 smithi187 ceph-mon[34367]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:50.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:49 smithi123 ceph-mon[34166]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:49 smithi060 ceph-mon[31244]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:52.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:51 smithi187 ceph-mon[34367]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:51 smithi123 ceph-mon[34166]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:51 smithi060 ceph-mon[31244]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:28:53.882 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:53 smithi123 ceph-mon[34166]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T07:28:54.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:53 smithi187 ceph-mon[34367]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T07:28:54.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:53 smithi060 ceph-mon[31244]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T07:28:55.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:55 smithi123 ceph-mon[34166]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:28:56.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:55 smithi187 ceph-mon[34367]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:28:56.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:55 smithi060 ceph-mon[31244]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:28:56.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:28:56.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:56.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:56 smithi123 ceph-mon[34166]: Deploying daemon osd.4 on smithi123 2024-09-21T07:28:57.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:28:57.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:57.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:56 smithi187 ceph-mon[34367]: Deploying daemon osd.4 on smithi123 2024-09-21T07:28:57.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:28:57.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:28:57.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:56 smithi060 ceph-mon[31244]: Deploying daemon osd.4 on smithi123 2024-09-21T07:28:58.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:57 smithi187 ceph-mon[34367]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:28:58.042 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:57 smithi060 ceph-mon[31244]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:28:58.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:57 smithi123 ceph-mon[34166]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:29:00.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:28:59 smithi187 ceph-mon[34367]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:29:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:28:59 smithi123 ceph-mon[34166]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:29:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:28:59 smithi060 ceph-mon[31244]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T07:29:01.790 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:01 smithi123 ceph-mon[34166]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:02.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:01 smithi187 ceph-mon[34367]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:02.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:01 smithi060 ceph-mon[31244]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:03.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:03.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:03.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:03.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:04.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:04 smithi123 ceph-mon[34166]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:04.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:04 smithi060 ceph-mon[31244]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:04 smithi187 ceph-mon[34367]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:05.471 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.471 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.471 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:05.471 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:05.471 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.472 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:05 smithi123 ceph-mon[34166]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:05.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:05 smithi187 ceph-mon[34367]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:05.772 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 4 on host 'smithi123' 2024-09-21T07:29:05.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.770+0000 7f6345ffb640 1 -- 172.21.15.123:0/335992229 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f634806bf30 con 0x7f63380b6510 2024-09-21T07:29:05.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f63380b6510 msgr2=0x7f63380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f63380b6510 0x7f63380b8a20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f633c009fc0 tx=0x7f633c005f90 comp rx=0 tx=0).stop 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 msgr2=0x7f634819b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 0x7f634819b1e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f634000eb10 tx=0x7f634000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 shutdown_connections 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f63380b6510 0x7f63380b8a20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6348104120 0x7f634819b1e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6348103780 0x7f634819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:05.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 --2- 172.21.15.123:0/335992229 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63481026f0 0x7f6348199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:05.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 >> 172.21.15.123:0/335992229 conn(0x7f63480fe080 msgr2=0x7f634806b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:05.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.772+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 shutdown_connections 2024-09-21T07:29:05.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:29:05.773+0000 7f634f04e640 1 -- 172.21.15.123:0/335992229 wait complete. 2024-09-21T07:29:05.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:05.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:05.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:05.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:05 smithi060 ceph-mon[31244]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:06.354 DEBUG:teuthology.orchestra.run.smithi123:osd.4> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T07:29:06.357 INFO:tasks.cephadm:Deploying osd.5 on smithi187 with /dev/vg_nvme/lv_3... 2024-09-21T07:29:06.357 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:29:06.581 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:06.581 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:06.581 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:06.614 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:29:06.735 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:06.735 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:06.735 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:06.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:06.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:06.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:07.597 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:07 smithi123 ceph-mon[34166]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:07.754 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:07 smithi187 ceph-mon[34367]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:07.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:07 smithi060 ceph-mon[31244]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:08.452 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 07:29:08 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T07:29:08.158+0000 7f5c3b27c640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:29:08.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:08 smithi187 ceph-mon[34367]: from='osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:29:08.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:08 smithi187 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:29:08.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:08 smithi060 ceph-mon[31244]: from='osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:29:08.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:08 smithi060 ceph-mon[31244]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:29:08.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:08 smithi123 ceph-mon[34166]: from='osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:29:08.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:08 smithi123 ceph-mon[34166]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:29:09.156 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:29:09.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_3 2024-09-21T07:29:09.430 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi123 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.732 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:09.733 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:09.733 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-21T07:29:09.733 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.733 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:09.733 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:09.733 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.849 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T07:29:09.465+0000 7f5c371fe640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:29:09.849 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T07:29:09.471+0000 7f5c32ffc640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:29:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:29:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:29:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi123 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:09.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi123 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:09.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:09.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi123 to 8544M 2024-09-21T07:29:09.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:09.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:09.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 -- 172.21.15.187:0/981551885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 msgr2=0x7ff544104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 --2- 172.21.15.187:0/981551885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff544104c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff534009900 tx=0x7ff53402a480 comp rx=0 tx=0).stop 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 -- 172.21.15.187:0/981551885 shutdown_connections 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 --2- 172.21.15.187:0/981551885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff544105220 0x7ff54410bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 --2- 172.21.15.187:0/981551885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff544104c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 --2- 172.21.15.187:0/981551885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5441037f0 0x7ff544103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 -- 172.21.15.187:0/981551885 >> 172.21.15.187:0/981551885 conn(0x7ff5440ff180 msgr2=0x7ff544101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 -- 172.21.15.187:0/981551885 shutdown_connections 2024-09-21T07:29:09.952 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.948+0000 7ff54b932640 1 -- 172.21.15.187:0/981551885 wait complete. 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 Processor -- start 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 -- start start 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5441037f0 0x7ff544199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff54419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105220 0x7ff54419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410f3d0 con 0x7ff544105220 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410f250 con 0x7ff5441037f0 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff54b932640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410f550 con 0x7ff544104880 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff548ecd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff54419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff548ecd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff54419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:35620/0 (socket says 172.21.15.187:35620) 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff548ecd640 1 -- 172.21.15.187:0/1060208419 learned_addr learned my addr 172.21.15.187:0/1060208419 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.949+0000 7ff5496ce640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5441037f0 0x7ff544199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:09.953 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff549ecf640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105220 0x7ff54419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff548ecd640 1 -- 172.21.15.187:0/1060208419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5441037f0 msgr2=0x7ff544199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff548ecd640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5441037f0 0x7ff544199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff548ecd640 1 -- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105220 msgr2=0x7ff54419b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff548ecd640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105220 0x7ff54419b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff548ecd640 1 -- 172.21.15.187:0/1060208419 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54419b9f0 con 0x7ff544104880 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff548ecd640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff54419a630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff534006010 tx=0x7ff534004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53403f030 con 0x7ff544104880 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff534003cb0 con 0x7ff544104880 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54419bc80 con 0x7ff544104880 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534035070 con 0x7ff544104880 2024-09-21T07:29:09.954 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.950+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441a2210 con 0x7ff544104880 2024-09-21T07:29:09.955 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.951+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff54410a9b0 con 0x7ff544104880 2024-09-21T07:29:09.955 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.953+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff534042030 con 0x7ff544104880 2024-09-21T07:29:09.955 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.953+0000 7ff53a7fc640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff5300b6510 0x7ff5300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:09.955 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.954+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7ff534106e90 con 0x7ff544104880 2024-09-21T07:29:09.955 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.954+0000 7ff5496ce640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff5300b6510 0x7ff5300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:09.956 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.954+0000 7ff5496ce640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff5300b6510 0x7ff5300b8a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff54000bbe0 tx=0x7ff54000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:09.958 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:09.957+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5340ce8b0 con 0x7ff544104880 2024-09-21T07:29:10.148 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:10.147+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff544063800 con 0x7ff5300b6510 2024-09-21T07:29:10.742 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:29:10.742 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:29:10.742 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:10.742 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:10.742 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:29:10.742 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:29:10.743 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:29:10.743 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:10 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:29:10.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:10 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:10.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:29:10.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:10 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:11 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:29:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:11 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:29:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:11 smithi187 ceph-mon[34367]: osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] boot 2024-09-21T07:29:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:11 smithi187 ceph-mon[34367]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T07:29:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:11 smithi187 ceph-mon[34367]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:11.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:11 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:29:11.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:11 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:29:11.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:11 smithi123 ceph-mon[34166]: osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] boot 2024-09-21T07:29:11.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:11 smithi123 ceph-mon[34166]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T07:29:11.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:11.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:11 smithi123 ceph-mon[34166]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:11.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:11 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:29:11.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:11 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:29:11.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:11 smithi060 ceph-mon[31244]: osd.4 [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] boot 2024-09-21T07:29:11.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:11 smithi060 ceph-mon[31244]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T07:29:11.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:29:11.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:11 smithi060 ceph-mon[31244]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:29:12.761 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:12 smithi187 ceph-mon[34367]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:29:12.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:12 smithi123 ceph-mon[34166]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:29:12.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:12 smithi060 ceph-mon[31244]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T07:29:13.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/1515827228' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"} : dispatch 2024-09-21T07:29:13.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"} : dispatch 2024-09-21T07:29:13.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"}]': finished 2024-09-21T07:29:13.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:29:13.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:13.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:13.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:13 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/3609816533' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/1515827228' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"} : dispatch 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"} : dispatch 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"}]': finished 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:13.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:13 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/3609816533' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/1515827228' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"} : dispatch 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"} : dispatch 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8498706f-736f-4998-b5e7-51c3d922e0b6"}]': finished 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:13.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:13 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/3609816533' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:29:15.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:15 smithi123 ceph-mon[34166]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:15 smithi060 ceph-mon[31244]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:15 smithi187 ceph-mon[34367]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:17.822 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:17 smithi187 ceph-mon[34367]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:17 smithi123 ceph-mon[34166]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:17.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:17 smithi060 ceph-mon[31244]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:19.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:19 smithi123 ceph-mon[34166]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:19.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:19 smithi060 ceph-mon[31244]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:19.900 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:19 smithi187 ceph-mon[34367]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:21.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:21 smithi123 ceph-mon[34166]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:21.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:29:21.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:21.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:21 smithi123 ceph-mon[34166]: Deploying daemon osd.5 on smithi187 2024-09-21T07:29:21.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:21 smithi060 ceph-mon[31244]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:21.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:29:21.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:21.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:21 smithi060 ceph-mon[31244]: Deploying daemon osd.5 on smithi187 2024-09-21T07:29:21.901 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:21 smithi187 ceph-mon[34367]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:21.901 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:29:21.901 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:21.902 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:21 smithi187 ceph-mon[34367]: Deploying daemon osd.5 on smithi187 2024-09-21T07:29:23.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:23 smithi123 ceph-mon[34166]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:23.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:23 smithi060 ceph-mon[31244]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:23.968 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:23 smithi187 ceph-mon[34367]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:25.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:25 smithi123 ceph-mon[34166]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:25.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:25 smithi060 ceph-mon[31244]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:26.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:25 smithi187 ceph-mon[34367]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:27.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:27 smithi123 ceph-mon[34166]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:27.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:27 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:27.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:27 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:27.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:27 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:27.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:27 smithi060 ceph-mon[31244]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:27.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:27 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:27.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:27 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:27.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:27 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:27.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:27 smithi187 ceph-mon[34367]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:27.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:27 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:27.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:27 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:27.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:27 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:29 smithi123 ceph-mon[34166]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:29.868 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:29 smithi187 ceph-mon[34367]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:29.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:29 smithi060 ceph-mon[31244]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:31.262 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.262 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.262 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:31.262 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:31.262 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:30 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:31.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:31.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:30 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:31.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:31.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:30 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:31.564 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.562+0000 7ff53a7fc640 1 -- 172.21.15.187:0/1060208419 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff544063800 con 0x7ff5300b6510 2024-09-21T07:29:31.564 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 5 on host 'smithi187' 2024-09-21T07:29:31.566 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff5300b6510 msgr2=0x7ff5300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff5300b6510 0x7ff5300b8a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff54000bbe0 tx=0x7ff54000b390 comp rx=0 tx=0).stop 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 msgr2=0x7ff54419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff54419a630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff534006010 tx=0x7ff534004340 comp rx=0 tx=0).stop 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 shutdown_connections 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff5300b6510 0x7ff5300b8a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105220 0x7ff54419b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff544104880 0x7ff54419a630 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 --2- 172.21.15.187:0/1060208419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5441037f0 0x7ff544199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 >> 172.21.15.187:0/1060208419 conn(0x7ff5440ff180 msgr2=0x7ff544107b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 shutdown_connections 2024-09-21T07:29:31.567 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:29:31.564+0000 7ff54b932640 1 -- 172.21.15.187:0/1060208419 wait complete. 2024-09-21T07:29:32.223 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:31 smithi187 ceph-mon[34367]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:32.224 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:32.224 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:32.224 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:32.252 DEBUG:teuthology.orchestra.run.smithi187:osd.5> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T07:29:32.255 INFO:tasks.cephadm:Deploying osd.6 on smithi060 with /dev/vg_nvme/lv_2... 2024-09-21T07:29:32.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:29:32.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:31 smithi060 ceph-mon[31244]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:32.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:32.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:32.284 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:31 smithi123 ceph-mon[34166]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:32.520 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:29:33.857 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 07:29:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T07:29:33.604+0000 7f693dc4c640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:29:34.192 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:33 smithi060 ceph-mon[31244]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:34.193 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:33 smithi060 ceph-mon[31244]: from='osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:29:34.193 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:33 smithi060 ceph-mon[31244]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:29:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:33 smithi187 ceph-mon[34367]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:33 smithi187 ceph-mon[34367]: from='osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:29:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:33 smithi187 ceph-mon[34367]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:29:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:33 smithi123 ceph-mon[34166]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:33 smithi123 ceph-mon[34166]: from='osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:29:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:33 smithi123 ceph-mon[34166]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:29:35.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:34 smithi060 ceph-mon[31244]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:29:35.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:34 smithi060 ceph-mon[31244]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:29:35.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:34 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:35.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:34 smithi060 ceph-mon[31244]: from='osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:29:35.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:34 smithi060 ceph-mon[31244]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:29:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:29:35.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:34 smithi187 ceph-mon[34367]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:29:35.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:34 smithi187 ceph-mon[34367]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:29:35.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:34 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:35.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:34 smithi187 ceph-mon[34367]: from='osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:29:35.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:34 smithi187 ceph-mon[34367]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:29:35.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-09-21T07:29:35.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:34 smithi123 ceph-mon[34166]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:29:35.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:34 smithi123 ceph-mon[34166]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:29:35.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:34 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:35.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:34 smithi123 ceph-mon[34166]: from='osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:29:35.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:34 smithi123 ceph-mon[34166]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:29:35.575 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:29:36.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 -- 172.21.15.60:0/4153973921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 msgr2=0x7efcc810b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:36.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 --2- 172.21.15.60:0/4153973921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc810b9b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009ca0 tx=0x7efcc002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:29:36.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 -- 172.21.15.60:0/4153973921 shutdown_connections 2024-09-21T07:29:36.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 --2- 172.21.15.60:0/4153973921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc810b9b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 --2- 172.21.15.60:0/4153973921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc8106900 0x7efcc8108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 --2- 172.21.15.60:0/4153973921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc806c660 0x7efcc81063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.044+0000 7efcce228640 1 -- 172.21.15.60:0/4153973921 >> 172.21.15.60:0/4153973921 conn(0x7efcc80fdfe0 msgr2=0x7efcc8100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.045+0000 7efcce228640 1 -- 172.21.15.60:0/4153973921 shutdown_connections 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.045+0000 7efcce228640 1 -- 172.21.15.60:0/4153973921 wait complete. 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.045+0000 7efcce228640 1 Processor -- start 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.045+0000 7efcce228640 1 -- start start 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcce228640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc806c660 0x7efcc81039f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcce228640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc8106900 0x7efcc81022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcce228640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc8102800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcce228640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcc810f3a0 con 0x7efcc81094a0 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcce228640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efcc810f220 con 0x7efcc8106900 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcce228640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efcc810f520 con 0x7efcc806c660 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc8102800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc8102800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60352/0 (socket says 172.21.15.60:60352) 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 -- 172.21.15.60:0/1359122371 learned_addr learned my addr 172.21.15.60:0/1359122371 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc6ffd640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc8106900 0x7efcc81022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc77fe640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc806c660 0x7efcc81039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 -- 172.21.15.60:0/1359122371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc806c660 msgr2=0x7efcc81039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc806c660 0x7efcc81039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 -- 172.21.15.60:0/1359122371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc8106900 msgr2=0x7efcc81022c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc8106900 0x7efcc81022c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 -- 172.21.15.60:0/1359122371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc8102f00 con 0x7efcc81094a0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.046+0000 7efcc7fff640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc8102800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efcc00097b0 tx=0x7efcc0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.047+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0004240 con 0x7efcc81094a0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.047+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcc002f380 con 0x7efcc81094a0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.047+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81a3ff0 con 0x7efcc81094a0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.047+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc002fc30 con 0x7efcc81094a0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.047+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc81a4390 con 0x7efcc81094a0 2024-09-21T07:29:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.048+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8106d50 con 0x7efcc81094a0 2024-09-21T07:29:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.051+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efcc00043e0 con 0x7efcc81094a0 2024-09-21T07:29:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.051+0000 7efcc4ff9640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcb00b6590 0x7efcb00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:29:36.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.051+0000 7efcc77fe640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcb00b6590 0x7efcb00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:29:36.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.051+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4286+0+0 (secure 0 0 0) 0x7efcc01078c0 con 0x7efcc81094a0 2024-09-21T07:29:36.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.052+0000 7efcc77fe640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcb00b6590 0x7efcb00b8aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efcb800bbe0 tx=0x7efcb800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:29:36.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.055+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcc00cf110 con 0x7efcc81094a0 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi187 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:36.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:36.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi187 to 8544M 2024-09-21T07:29:36.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:36.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:36.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:35 smithi060 ceph-mon[31244]: from='osd.5 ' entity='osd.5' 2024-09-21T07:29:36.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:36.251+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7efcc8063800 con 0x7efcb00b6590 2024-09-21T07:29:36.269 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T07:29:35.837+0000 7f6939bce640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:29:36.270 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T07:29:36.007+0000 7f69319c4640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi187 2024-09-21T07:29:36.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi187 to 8544M 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:35 smithi187 ceph-mon[34367]: from='osd.5 ' entity='osd.5' 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi187 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi187 to 8544M 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:36.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:35 smithi123 ceph-mon[34166]: from='osd.5 ' entity='osd.5' 2024-09-21T07:29:37.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:29:37.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:36 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:29:37.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:36 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:37.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:29:37.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:36 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:38.210 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:37 smithi060 ceph-mon[31244]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:38.211 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:38.211 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:37 smithi060 ceph-mon[31244]: osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] boot 2024-09-21T07:29:38.211 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:37 smithi060 ceph-mon[31244]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:29:38.211 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:37 smithi187 ceph-mon[34367]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:37 smithi187 ceph-mon[34367]: osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] boot 2024-09-21T07:29:38.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:37 smithi187 ceph-mon[34367]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:29:38.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:37 smithi123 ceph-mon[34166]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:29:38.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:38.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:37 smithi123 ceph-mon[34166]: osd.5 [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] boot 2024-09-21T07:29:38.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:37 smithi123 ceph-mon[34166]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:29:38.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:29:39.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:38 smithi187 ceph-mon[34367]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:29:39.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:38 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1567736475' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6853e674-76d8-43c3-a656-f497be510006"} : dispatch 2024-09-21T07:29:39.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:38 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1567736475' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6853e674-76d8-43c3-a656-f497be510006"}]': finished 2024-09-21T07:29:39.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:38 smithi187 ceph-mon[34367]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:29:39.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:38 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:29:39.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:38 smithi123 ceph-mon[34166]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:29:39.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:38 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1567736475' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6853e674-76d8-43c3-a656-f497be510006"} : dispatch 2024-09-21T07:29:39.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:38 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1567736475' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6853e674-76d8-43c3-a656-f497be510006"}]': finished 2024-09-21T07:29:39.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:38 smithi123 ceph-mon[34166]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:29:39.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:38 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:29:39.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:38 smithi060 ceph-mon[31244]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T07:29:39.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:38 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1567736475' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6853e674-76d8-43c3-a656-f497be510006"} : dispatch 2024-09-21T07:29:39.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:38 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1567736475' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6853e674-76d8-43c3-a656-f497be510006"}]': finished 2024-09-21T07:29:39.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:38 smithi060 ceph-mon[31244]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:29:39.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:38 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:29:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:39 smithi187 ceph-mon[34367]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:39 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4167195075' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:29:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:39 smithi123 ceph-mon[34166]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:40.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:39 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4167195075' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:29:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:39 smithi060 ceph-mon[31244]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:39 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4167195075' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:29:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:41 smithi187 ceph-mon[34367]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:41 smithi123 ceph-mon[34166]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:41 smithi060 ceph-mon[31244]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:44.074 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:43 smithi060 ceph-mon[31244]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:29:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:43 smithi187 ceph-mon[34367]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:29:44.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:43 smithi123 ceph-mon[34166]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:29:46.096 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:45 smithi060 ceph-mon[31244]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T07:29:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:45 smithi187 ceph-mon[34367]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T07:29:46.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:45 smithi123 ceph-mon[34166]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-21T07:29:47.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:29:47.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:47.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:29:47.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:47.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:29:47.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:47 smithi187 ceph-mon[34367]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T07:29:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:47 smithi187 ceph-mon[34367]: Deploying daemon osd.6 on smithi060 2024-09-21T07:29:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:47 smithi123 ceph-mon[34166]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T07:29:48.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:47 smithi123 ceph-mon[34166]: Deploying daemon osd.6 on smithi060 2024-09-21T07:29:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:47 smithi060 ceph-mon[31244]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-21T07:29:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:47 smithi060 ceph-mon[31244]: Deploying daemon osd.6 on smithi060 2024-09-21T07:29:50.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:49 smithi060 ceph-mon[31244]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:29:50.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:49 smithi187 ceph-mon[34367]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:29:50.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:49 smithi123 ceph-mon[34166]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:29:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:51 smithi187 ceph-mon[34367]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:29:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:51 smithi123 ceph-mon[34166]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:29:52.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:51 smithi060 ceph-mon[31244]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:29:53.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:53.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:53.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:53.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:53.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:53.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:53.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:53.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:53.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:54 smithi187 ceph-mon[34367]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:54.270 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:54 smithi060 ceph-mon[31244]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:54.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:54 smithi123 ceph-mon[34166]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:29:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:56 smithi187 ceph-mon[34367]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:56.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:56.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:56 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:56 smithi060 ceph-mon[31244]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:56.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:56.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:56.275 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:56 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.317+0000 7efcc4ff9640 1 -- 172.21.15.60:0/1359122371 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efcc8063800 con 0x7efcb00b6590 2024-09-21T07:29:56.320 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 6 on host 'smithi060' 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcb00b6590 msgr2=0x7efcb00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcb00b6590 0x7efcb00b8aa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efcb800bbe0 tx=0x7efcb800b390 comp rx=0 tx=0).stop 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 msgr2=0x7efcc8102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc8102800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efcc00097b0 tx=0x7efcc0003c20 comp rx=0 tx=0).stop 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 shutdown_connections 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efcb00b6590 0x7efcb00b8aa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc81094a0 0x7efcc8102800 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efcc8106900 0x7efcc81022c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 --2- 172.21.15.60:0/1359122371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efcc806c660 0x7efcc81039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:29:56.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 >> 172.21.15.60:0/1359122371 conn(0x7efcc80fdfe0 msgr2=0x7efcc8104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:29:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 shutdown_connections 2024-09-21T07:29:56.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:29:56.321+0000 7efcce228640 1 -- 172.21.15.60:0/1359122371 wait complete. 2024-09-21T07:29:56.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:56 smithi123 ceph-mon[34166]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:56.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:29:56.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:29:56.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:56 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:56.922 DEBUG:teuthology.orchestra.run.smithi060:osd.6> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T07:29:56.924 INFO:tasks.cephadm:Deploying osd.7 on smithi123 with /dev/vg_nvme/lv_2... 2024-09-21T07:29:56.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:29:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:29:57.237 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:57.237 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:57.237 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:57.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:57.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:57.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:57.299 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:29:57.300 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:57.300 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:29:58.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:58 smithi060 ceph-mon[31244]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:58.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:58 smithi123 ceph-mon[34166]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:58.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:58 smithi187 ceph-mon[34367]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:29:59.122 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 07:29:58 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T07:29:58.782+0000 7efdbbf2c640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:29:59.557 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:29:59 smithi060 ceph-mon[31244]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:29:59.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:29:59 smithi123 ceph-mon[34166]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:29:59.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:29:59 smithi187 ceph-mon[34367]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:29:59.776 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:29:59.810 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-09-21T07:30:00.060 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:30:00.451 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:30:00.451 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.452 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:00 smithi123 ceph-mon[34166]: overall HEALTH_OK 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 -- 172.21.15.123:0/2943624252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c1036d0 msgr2=0x7f186c103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 --2- 172.21.15.123:0/2943624252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c1036d0 0x7f186c103ae0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1868009900 tx=0x7f186802a480 comp rx=0 tx=0).stop 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 -- 172.21.15.123:0/2943624252 shutdown_connections 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 --2- 172.21.15.123:0/2943624252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f186c104070 0x7f186c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 --2- 172.21.15.123:0/2943624252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c1036d0 0x7f186c103ae0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 --2- 172.21.15.123:0/2943624252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186c102640 0x7f186c102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 -- 172.21.15.123:0/2943624252 >> 172.21.15.123:0/2943624252 conn(0x7f186c0fdfb0 msgr2=0x7f186c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 -- 172.21.15.123:0/2943624252 shutdown_connections 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.543+0000 7f18746e2640 1 -- 172.21.15.123:0/2943624252 wait complete. 2024-09-21T07:30:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 Processor -- start 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 -- start start 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 0x7f186c199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f186c1036d0 0x7f186c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186c104070 0x7f186c19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f186c10e290 con 0x7f186c104070 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f186c10e110 con 0x7f186c102640 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f18746e2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f186c10e410 con 0x7f186c1036d0 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f187247e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 0x7f186c199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f187247e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 0x7f186c199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39252/0 (socket says 172.21.15.123:39252) 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f187247e640 1 -- 172.21.15.123:0/1760811511 learned_addr learned my addr 172.21.15.123:0/1760811511 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f1872c7f640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186c104070 0x7f186c19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.544+0000 7f1871c7d640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f186c1036d0 0x7f186c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f187247e640 1 -- 172.21.15.123:0/1760811511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f186c1036d0 msgr2=0x7f186c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f187247e640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f186c1036d0 0x7f186c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f187247e640 1 -- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186c104070 msgr2=0x7f186c19b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f187247e640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186c104070 0x7f186c19b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f187247e640 1 -- 172.21.15.123:0/1760811511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c19b9d0 con 0x7f186c102640 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f187247e640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 0x7f186c199fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f186000d950 tx=0x7f186000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860017030 con 0x7f186c102640 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1860004020 con 0x7f186c102640 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c19bcc0 con 0x7f186c102640 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18600047a0 con 0x7f186c102640 2024-09-21T07:30:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.545+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c1a23c0 con 0x7f186c102640 2024-09-21T07:30:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.546+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186c1a2590 con 0x7f186c102640 2024-09-21T07:30:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.548+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1860009a30 con 0x7f186c102640 2024-09-21T07:30:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.549+0000 7f185f7fe640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f18580b6510 0x7f18580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.549+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4685+0+0 (secure 0 0 0) 0x7f18600e6540 con 0x7f186c102640 2024-09-21T07:30:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.549+0000 7f1871c7d640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f18580b6510 0x7f18580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.550+0000 7f1871c7d640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f18580b6510 0x7f18580b8a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1868000c00 tx=0x7f1868031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:00.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.552+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18600adc00 con 0x7f186c102640 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:00.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:00.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:00 smithi060 ceph-mon[31244]: overall HEALTH_OK 2024-09-21T07:30:00.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:00.738+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f186c0fffb0 con 0x7f18580b6510 2024-09-21T07:30:00.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:00.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:00.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:00.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:00 smithi187 ceph-mon[34367]: overall HEALTH_OK 2024-09-21T07:30:01.335 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T07:30:01.079+0000 7efdb7eae640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:30:01.335 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T07:30:01.088+0000 7efdafca4640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi060 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:01.429 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:01.430 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:01.430 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:01.430 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:01 smithi123 ceph-mon[34166]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi060 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:01.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:01.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:01 smithi060 ceph-mon[31244]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' 2024-09-21T07:30:01.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi060 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:01.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:01 smithi187 ceph-mon[34367]: from='osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627]' entity='osd.6' 2024-09-21T07:30:02.594 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:02 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:30:02.594 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:02 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:30:02.594 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:02.594 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:02 smithi123 ceph-mon[34166]: osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] boot 2024-09-21T07:30:02.595 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:02 smithi123 ceph-mon[34166]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T07:30:02.595 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:02.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:02 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:30:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:02 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:30:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:02 smithi060 ceph-mon[31244]: osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] boot 2024-09-21T07:30:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:02 smithi060 ceph-mon[31244]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T07:30:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:02.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:02 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:30:02.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:02 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:30:02.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:02 smithi187 ceph-mon[34367]: osd.6 [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] boot 2024-09-21T07:30:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:02 smithi187 ceph-mon[34367]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T07:30:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:30:03.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:03 smithi123 ceph-mon[34166]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:03.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:03 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/1143947490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"} : dispatch 2024-09-21T07:30:03.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:03 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"} : dispatch 2024-09-21T07:30:03.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:03 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"}]': finished 2024-09-21T07:30:03.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:03 smithi123 ceph-mon[34166]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:30:03.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:03.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:03 smithi060 ceph-mon[31244]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:03 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/1143947490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"} : dispatch 2024-09-21T07:30:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:03 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"} : dispatch 2024-09-21T07:30:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:03 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"}]': finished 2024-09-21T07:30:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:03 smithi060 ceph-mon[31244]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:30:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:03.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:03 smithi187 ceph-mon[34367]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:03 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/1143947490' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"} : dispatch 2024-09-21T07:30:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:03 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"} : dispatch 2024-09-21T07:30:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:03 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b7b6ec-445e-4ac5-991a-4c83fc17703b"}]': finished 2024-09-21T07:30:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:03 smithi187 ceph-mon[34367]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:30:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:04.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:04 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/2791033397' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:04.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:04 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/2791033397' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:04.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:04 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/2791033397' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:05 smithi187 ceph-mon[34367]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:05.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:05 smithi123 ceph-mon[34166]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:05.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:05 smithi060 ceph-mon[31244]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:07.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:07 smithi060 ceph-mon[31244]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:08.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:07 smithi187 ceph-mon[34367]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:07 smithi123 ceph-mon[34166]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:09 smithi060 ceph-mon[31244]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:09.936 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:09 smithi123 ceph-mon[34166]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:09 smithi187 ceph-mon[34367]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:11.796 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:11 smithi123 ceph-mon[34166]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:12.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:11 smithi187 ceph-mon[34367]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:12.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:11 smithi060 ceph-mon[31244]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:12.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:12 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:30:12.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:12 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:12.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:12 smithi123 ceph-mon[34166]: Deploying daemon osd.7 on smithi123 2024-09-21T07:30:13.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:12 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:30:13.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:12 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:13.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:12 smithi187 ceph-mon[34367]: Deploying daemon osd.7 on smithi123 2024-09-21T07:30:13.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:12 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:30:13.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:12 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:13.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:12 smithi060 ceph-mon[31244]: Deploying daemon osd.7 on smithi123 2024-09-21T07:30:13.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:13 smithi123 ceph-mon[34166]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:14.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:13 smithi187 ceph-mon[34367]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:14.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:13 smithi060 ceph-mon[31244]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:15 smithi187 ceph-mon[34367]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:16.030 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:15 smithi123 ceph-mon[34166]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:15 smithi060 ceph-mon[31244]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:17 smithi123 ceph-mon[34166]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:18.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:17 smithi187 ceph-mon[34367]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:18.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:18.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:18.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:18.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:17 smithi060 ceph-mon[31244]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:18.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:18.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:18.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:19.907 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:19 smithi123 ceph-mon[34166]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:20.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:19 smithi187 ceph-mon[34367]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:20.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:19 smithi060 ceph-mon[31244]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:21.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.125+0000 7f185f7fe640 1 -- 172.21.15.123:0/1760811511 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f186c0fffb0 con 0x7f18580b6510 2024-09-21T07:30:21.130 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 7 on host 'smithi123' 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f18580b6510 msgr2=0x7f18580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f18580b6510 0x7f18580b8a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1868000c00 tx=0x7f1868031400 comp rx=0 tx=0).stop 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 msgr2=0x7f186c199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 0x7f186c199fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f186000d950 tx=0x7f186000de10 comp rx=0 tx=0).stop 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 shutdown_connections 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f18580b6510 0x7f18580b8a20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:21.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f186c104070 0x7f186c19b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:21.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f186c1036d0 0x7f186c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:21.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 --2- 172.21.15.123:0/1760811511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c102640 0x7f186c199fa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:21.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 >> 172.21.15.123:0/1760811511 conn(0x7f186c0fdfb0 msgr2=0x7f186c0ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:21.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 shutdown_connections 2024-09-21T07:30:21.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:30:21.128+0000 7f18746e2640 1 -- 172.21.15.123:0/1760811511 wait complete. 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.447 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:21.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:21.749 DEBUG:teuthology.orchestra.run.smithi123:osd.7> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T07:30:21.751 INFO:tasks.cephadm:Deploying osd.8 on smithi187 with /dev/vg_nvme/lv_2... 2024-09-21T07:30:21.751 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:30:22.011 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:30:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:22 smithi123 ceph-mon[34166]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:22.459 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:22 smithi187 ceph-mon[34367]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:22 smithi060 ceph-mon[31244]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:23.332 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 07:30:23 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T07:30:23.290+0000 7fdb997bc640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:30:24.260 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:24 smithi123 ceph-mon[34166]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:24.260 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:24 smithi123 ceph-mon[34166]: from='osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:30:24.260 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:24 smithi123 ceph-mon[34166]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:30:24.461 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:24 smithi187 ceph-mon[34367]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:24.461 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:24 smithi187 ceph-mon[34367]: from='osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:30:24.461 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:24 smithi187 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:30:24.465 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:30:24.495 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_2 2024-09-21T07:30:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:24 smithi060 ceph-mon[31244]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:24.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:24 smithi060 ceph-mon[31244]: from='osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:30:24.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:24 smithi060 ceph-mon[31244]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:30:24.750 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 -- 172.21.15.187:0/3388144978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984102d10 msgr2=0x7ff984105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 --2- 172.21.15.187:0/3388144978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984102d10 0x7ff984105130 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff974009900 tx=0x7ff97402a410 comp rx=0 tx=0).stop 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 -- 172.21.15.187:0/3388144978 shutdown_connections 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 --2- 172.21.15.187:0/3388144978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984108370 0x7ff98410a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 --2- 172.21.15.187:0/3388144978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff984105750 0x7ff984107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 --2- 172.21.15.187:0/3388144978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984102d10 0x7ff984105130 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 -- 172.21.15.187:0/3388144978 >> 172.21.15.187:0/3388144978 conn(0x7ff9840fd770 msgr2=0x7ff9840ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:25.231 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 -- 172.21.15.187:0/3388144978 shutdown_connections 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.222+0000 7ff989b4c640 1 -- 172.21.15.187:0/3388144978 wait complete. 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 Processor -- start 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 -- start start 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff984102d10 0x7ff984199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984105750 0x7ff98419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 0x7ff98419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff98410e270 con 0x7ff984105750 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff98410e0f0 con 0x7ff984102d10 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff989b4c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff98410e3f0 con 0x7ff984108370 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 0x7ff98419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 0x7ff98419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:42236/0 (socket says 172.21.15.187:42236) 2024-09-21T07:30:25.232 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 -- 172.21.15.187:0/325567541 learned_addr learned my addr 172.21.15.187:0/325567541 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff9837fe640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff984102d10 0x7ff984199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff97bfff640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984105750 0x7ff98419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 -- 172.21.15.187:0/325567541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff984102d10 msgr2=0x7ff984199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff984102d10 0x7ff984199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 -- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984105750 msgr2=0x7ff98419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984105750 0x7ff98419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff983fff640 1 -- 172.21.15.187:0/325567541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98419b9c0 con 0x7ff984108370 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.223+0000 7ff97bfff640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984105750 0x7ff98419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.224+0000 7ff983fff640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 0x7ff98419b1a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009fd0 tx=0x7ff97c00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.224+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c017070 con 0x7ff984108370 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.224+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98419bcb0 con 0x7ff984108370 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.224+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97c003e20 con 0x7ff984108370 2024-09-21T07:30:25.233 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.224+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c010460 con 0x7ff984108370 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.224+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9841a23b0 con 0x7ff984108370 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.225+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9841a25e0 con 0x7ff984108370 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.227+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff97c003970 con 0x7ff984108370 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.228+0000 7ff9817fa640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9700b6510 0x7ff9700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.228+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5117+0+0 (secure 0 0 0) 0x7ff97c0e6420 con 0x7ff984108370 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.228+0000 7ff9837fe640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9700b6510 0x7ff9700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.229+0000 7ff9837fe640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9700b6510 0x7ff9700b8a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff974000c00 tx=0x7ff974031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:25.234 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.231+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff97c0ad930 con 0x7ff984108370 2024-09-21T07:30:25.427 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:25.425+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff9841a27b0 con 0x7ff9700b6510 2024-09-21T07:30:25.427 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:30:25.427 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:30:25.427 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:25.427 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:30:25.427 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:25.428 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:25.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:25.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:25.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:25.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi123 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:26.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:26.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:26.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:26.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:26.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:26 smithi187 ceph-mon[34367]: from='osd.7 ' entity='osd.7' 2024-09-21T07:30:26.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T07:30:26.099+0000 7fdb9573e640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:30:26.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T07:30:26.287+0000 7fdb8d534640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:30:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi123 2024-09-21T07:30:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:26.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:26 smithi123 ceph-mon[34166]: from='osd.7 ' entity='osd.7' 2024-09-21T07:30:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi123 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi123 to 5696M 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:26 smithi060 ceph-mon[31244]: from='osd.7 ' entity='osd.7' 2024-09-21T07:30:27.407 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:27 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:30:27.407 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:27 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:30:27.407 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:27 smithi187 ceph-mon[34367]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:27.407 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:27 smithi187 ceph-mon[34367]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:30:27.407 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:27 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:27.407 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:27 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:27.523 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:27 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:30:27.523 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:27 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:30:27.523 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:27 smithi060 ceph-mon[31244]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:27.523 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:27 smithi060 ceph-mon[31244]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:30:27.523 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:27 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:27.523 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:27 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:27.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:27 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:30:27.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:27 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:30:27.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:27 smithi123 ceph-mon[34166]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:27.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:27 smithi123 ceph-mon[34166]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T07:30:27.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:27 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:27.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:27 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:28.374 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:28.374 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] boot 2024-09-21T07:30:28.374 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T07:30:28.374 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:28.375 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/3737651774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"} : dispatch 2024-09-21T07:30:28.375 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"} : dispatch 2024-09-21T07:30:28.375 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"}]': finished 2024-09-21T07:30:28.375 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T07:30:28.375 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:28 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] boot 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/3737651774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"} : dispatch 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"} : dispatch 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"}]': finished 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T07:30:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:28 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: osd.7 [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] boot 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/3737651774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"} : dispatch 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"} : dispatch 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccbf9802-3c77-410f-ad6e-b28906ed622e"}]': finished 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: osdmap e47: 9 total, 8 up, 9 in 2024-09-21T07:30:28.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:28 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:29.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:29 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/2437141400' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:29.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:29 smithi187 ceph-mon[34367]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:30:29.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:29.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:29 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/2437141400' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:29.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:29 smithi123 ceph-mon[34166]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:30:29.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:29.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:29 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/2437141400' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:29.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:29 smithi060 ceph-mon[31244]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:30:29.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:30 smithi187 ceph-mon[34367]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:30 smithi123 ceph-mon[34166]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:30.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:30 smithi060 ceph-mon[31244]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:32 smithi187 ceph-mon[34367]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:32 smithi123 ceph-mon[34166]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:32 smithi060 ceph-mon[31244]: pgmap v187: 1 pgs: 1 peering; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:34.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:34 smithi187 ceph-mon[34367]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:34 smithi123 ceph-mon[34166]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:34 smithi060 ceph-mon[31244]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 252 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:36.467 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:36 smithi187 ceph-mon[34367]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T07:30:36.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:36 smithi060 ceph-mon[31244]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T07:30:36.777 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:36 smithi123 ceph-mon[34166]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T07:30:37.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:30:37.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:30:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:30:37.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:38.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:38 smithi187 ceph-mon[34367]: Deploying daemon osd.8 on smithi187 2024-09-21T07:30:38.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:38 smithi187 ceph-mon[34367]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:30:38.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:38 smithi123 ceph-mon[34166]: Deploying daemon osd.8 on smithi187 2024-09-21T07:30:38.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:38 smithi123 ceph-mon[34166]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:30:38.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:38 smithi060 ceph-mon[31244]: Deploying daemon osd.8 on smithi187 2024-09-21T07:30:38.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:38 smithi060 ceph-mon[31244]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:30:40.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:40 smithi187 ceph-mon[34367]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:30:40.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:40 smithi123 ceph-mon[34166]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:30:40.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:40 smithi060 ceph-mon[31244]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:30:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:42 smithi187 ceph-mon[34367]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:30:42.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:42 smithi123 ceph-mon[34166]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:30:42.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:42 smithi060 ceph-mon[31244]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T07:30:43.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:43 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:43.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:43 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:43.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:43 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:43.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:43 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:43.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:43 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:43.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:43 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:43.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:43 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:43.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:43 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:43.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:43 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:44.500 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:44 smithi187 ceph-mon[34367]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:30:44.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:44 smithi123 ceph-mon[34166]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:30:44.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:44 smithi060 ceph-mon[31244]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:30:46.314 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.312+0000 7ff9817fa640 1 -- 172.21.15.187:0/325567541 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff9841a27b0 con 0x7ff9700b6510 2024-09-21T07:30:46.315 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 8 on host 'smithi187' 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9700b6510 msgr2=0x7ff9700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9700b6510 0x7ff9700b8a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff974000c00 tx=0x7ff974031400 comp rx=0 tx=0).stop 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 msgr2=0x7ff98419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 0x7ff98419b1a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009fd0 tx=0x7ff97c00b260 comp rx=0 tx=0).stop 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 shutdown_connections 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9700b6510 0x7ff9700b8a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff984108370 0x7ff98419b1a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.318 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff984105750 0x7ff98419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.318 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 --2- 172.21.15.187:0/325567541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff984102d10 0x7ff984199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:46.318 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 >> 172.21.15.187:0/325567541 conn(0x7ff9840fd770 msgr2=0x7ff984107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:46.318 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 shutdown_connections 2024-09-21T07:30:46.318 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:30:46.315+0000 7ff989b4c640 1 -- 172.21.15.187:0/325567541 wait complete. 2024-09-21T07:30:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:46 smithi187 ceph-mon[34367]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:30:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:46.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:46 smithi123 ceph-mon[34166]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:30:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:46 smithi060 ceph-mon[31244]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:30:46.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:46.919 DEBUG:teuthology.orchestra.run.smithi187:osd.8> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T07:30:46.922 INFO:tasks.cephadm:Deploying osd.9 on smithi060 with /dev/vg_nvme/lv_1... 2024-09-21T07:30:46.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:30:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:30:47.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:47 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:47.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:47 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:47.501 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:47 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:47.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:47 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:47.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:47 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:47.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:47 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:47.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:47 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:30:47.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:47 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:47.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:47 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:48.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:48 smithi187 ceph-mon[34367]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:48.587 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:48 smithi060 ceph-mon[31244]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:48 smithi123 ceph-mon[34166]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:48.770 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 07:30:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T07:30:48.606+0000 7f6cdd1e0640 -1 osd.8 0 log_to_monitors true 2024-09-21T07:30:49.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:49 smithi187 ceph-mon[34367]: from='osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:30:49.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:49 smithi187 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:30:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:49 smithi123 ceph-mon[34166]: from='osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:30:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:49 smithi123 ceph-mon[34166]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:30:49.606 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:49 smithi060 ceph-mon[31244]: from='osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:30:49.606 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:49 smithi060 ceph-mon[31244]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:30:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:30:49.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2024-09-21T07:30:50.057 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:30:50.476 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:50.477 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 -- 172.21.15.60:0/2679293895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 msgr2=0x7f80c0103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 --2- 172.21.15.60:0/2679293895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0103b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a802a480 comp rx=0 tx=0).stop 2024-09-21T07:30:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 -- 172.21.15.60:0/2679293895 shutdown_connections 2024-09-21T07:30:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 --2- 172.21.15.60:0/2679293895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80c01040c0 0x7f80c010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 --2- 172.21.15.60:0/2679293895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0103b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 --2- 172.21.15.60:0/2679293895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0102690 0x7f80c0102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 -- 172.21.15.60:0/2679293895 >> 172.21.15.60:0/2679293895 conn(0x7f80c00fe000 msgr2=0x7f80c01004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 -- 172.21.15.60:0/2679293895 shutdown_connections 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 -- 172.21.15.60:0/2679293895 wait complete. 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.571+0000 7f80c582b640 1 Processor -- start 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 -- start start 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0102690 0x7f80c0106280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0104b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:50.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80c01040c0 0x7f80c0105090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:50.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80c010e2c0 con 0x7f80c0103720 2024-09-21T07:30:50.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f80c010e140 con 0x7f80c0102690 2024-09-21T07:30:50.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80c582b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f80c010e440 con 0x7f80c01040c0 2024-09-21T07:30:50.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0104b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0104b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52110/0 (socket says 172.21.15.60:52110) 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 -- 172.21.15.60:0/591524124 learned_addr learned my addr 172.21.15.60:0/591524124 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80bf7fe640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80c01040c0 0x7f80c0105090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80beffd640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0102690 0x7f80c0106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 -- 172.21.15.60:0/591524124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80c01040c0 msgr2=0x7f80c0105090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80c01040c0 0x7f80c0105090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 -- 172.21.15.60:0/591524124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0102690 msgr2=0x7f80c0106280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0102690 0x7f80c0106280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:30:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.572+0000 7f80b67fc640 1 -- 172.21.15.60:0/591524124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c0105790 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.573+0000 7f80b67fc640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0104b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f80a8006010 tx=0x7f80a8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.573+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a803f030 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.573+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80a8003aa0 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.573+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c01a40d0 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.573+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a8035070 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.573+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c01a4470 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.574+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c01a46d0 con 0x7f80c0103720 2024-09-21T07:30:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.577+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f80a8042030 con 0x7f80c0103720 2024-09-21T07:30:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.578+0000 7f80c4829640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f80ac0b6510 0x7f80ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:30:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.578+0000 7f80beffd640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f80ac0b6510 0x7f80ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:30:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.578+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7f80a81074a0 con 0x7f80c0103720 2024-09-21T07:30:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.578+0000 7f80beffd640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f80ac0b6510 0x7f80ac0b8a20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f80b000bbe0 tx=0x7f80b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:30:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.581+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80a80d2b40 con 0x7f80c0103720 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:30:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:50.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:30:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:30:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:30:50.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:30:50.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:30:50.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:50.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:30:50.772 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:30:50.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:30:50.779+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f80c00fffc0 con 0x7f80ac0b6510 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi187 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi187 to 5696M 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:51.421 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:51.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:51.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:51 smithi060 ceph-mon[31244]: from='osd.8 ' entity='osd.8' 2024-09-21T07:30:51.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T07:30:51.242+0000 7f6cd9162640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T07:30:51.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T07:30:51.403+0000 7f6cd0f58640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi187 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi187 to 5696M 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:51.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:51 smithi187 ceph-mon[34367]: from='osd.8 ' entity='osd.8' 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi187 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi187 to 5696M 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:30:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:51 smithi123 ceph-mon[34166]: from='osd.8 ' entity='osd.8' 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:30:52.418 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:52 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:30:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:52 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:30:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:30:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: from='client.14595 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:30:52.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:52.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T07:30:52.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:52 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] boot 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2217071171' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aff3c884-5283-4516-877a-c4b25cccb08b"} : dispatch 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2217071171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aff3c884-5283-4516-877a-c4b25cccb08b"}]': finished 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T07:30:53.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:53 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] boot 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2217071171' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aff3c884-5283-4516-877a-c4b25cccb08b"} : dispatch 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2217071171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aff3c884-5283-4516-877a-c4b25cccb08b"}]': finished 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T07:30:53.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:53 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:30:53.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: osd.8 [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] boot 2024-09-21T07:30:53.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:30:53.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:30:53.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2217071171' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aff3c884-5283-4516-877a-c4b25cccb08b"} : dispatch 2024-09-21T07:30:53.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2217071171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aff3c884-5283-4516-877a-c4b25cccb08b"}]': finished 2024-09-21T07:30:53.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: osdmap e53: 10 total, 9 up, 10 in 2024-09-21T07:30:53.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:53 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:30:54.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:54 smithi123 ceph-mon[34166]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:54 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4005652581' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:54 smithi123 ceph-mon[34166]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:30:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:54 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:30:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:54 smithi060 ceph-mon[31244]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:54.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:54 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4005652581' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:54.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:54 smithi060 ceph-mon[31244]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:30:54.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:54 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:30:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:54 smithi187 ceph-mon[34367]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 253 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:30:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:54 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4005652581' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:30:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:54 smithi187 ceph-mon[34367]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:30:54.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:54 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:30:56.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:56 smithi123 ceph-mon[34166]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:30:56.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:56 smithi060 ceph-mon[31244]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:30:56.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:56 smithi187 ceph-mon[34367]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:30:57.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:57 smithi187 ceph-mon[34367]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:30:57.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:57 smithi123 ceph-mon[34166]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:30:57.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:57 smithi060 ceph-mon[31244]: pgmap v206: 1 pgs: 1 remapped+peering; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:30:59.837 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:30:59 smithi060 ceph-mon[31244]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T07:30:59.890 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:30:59 smithi187 ceph-mon[34367]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T07:31:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:30:59 smithi123 ceph-mon[34166]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-21T07:31:01.866 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:01 smithi060 ceph-mon[31244]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:31:02.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:01 smithi187 ceph-mon[34367]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:31:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:01 smithi123 ceph-mon[34166]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T07:31:02.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:31:02.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:02.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:02 smithi060 ceph-mon[31244]: Deploying daemon osd.9 on smithi060 2024-09-21T07:31:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:31:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:02 smithi187 ceph-mon[34367]: Deploying daemon osd.9 on smithi060 2024-09-21T07:31:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:31:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:02 smithi123 ceph-mon[34166]: Deploying daemon osd.9 on smithi060 2024-09-21T07:31:03.824 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:03 smithi060 ceph-mon[31244]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:31:04.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:03 smithi187 ceph-mon[34367]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:31:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:03 smithi123 ceph-mon[34166]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T07:31:05.690 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:05 smithi060 ceph-mon[31244]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:31:06.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:05 smithi187 ceph-mon[34367]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:31:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:05 smithi123 ceph-mon[34166]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:31:07.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:07 smithi060 ceph-mon[31244]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:08.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:07 smithi187 ceph-mon[34367]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:07 smithi123 ceph-mon[34166]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:08.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:08 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:08.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:08 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:08.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:08 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:09.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:08 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:09.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:08 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:09.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:08 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:09.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:08 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:09.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:08 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:09.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:08 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:09 smithi187 ceph-mon[34367]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:09 smithi123 ceph-mon[34166]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:10.104 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:09 smithi060 ceph-mon[31244]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.080+0000 7f80c4829640 1 -- 172.21.15.60:0/591524124 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f80c00fffc0 con 0x7f80ac0b6510 2024-09-21T07:31:11.083 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 9 on host 'smithi060' 2024-09-21T07:31:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.082+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f80ac0b6510 msgr2=0x7f80ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.082+0000 7f80c582b640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f80ac0b6510 0x7f80ac0b8a20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f80b000bbe0 tx=0x7f80b000b390 comp rx=0 tx=0).stop 2024-09-21T07:31:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.082+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 msgr2=0x7f80c0104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.082+0000 7f80c582b640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0104b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f80a8006010 tx=0x7f80a8031a50 comp rx=0 tx=0).stop 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 shutdown_connections 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f80ac0b6510 0x7f80ac0b8a20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80c01040c0 0x7f80c0105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c0103720 0x7f80c0104b50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 --2- 172.21.15.60:0/591524124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0102690 0x7f80c0106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 >> 172.21.15.60:0/591524124 conn(0x7f80c00fe000 msgr2=0x7f80c00ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 shutdown_connections 2024-09-21T07:31:11.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:31:11.083+0000 7f80c582b640 1 -- 172.21.15.60:0/591524124 wait complete. 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:11 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.757 DEBUG:teuthology.orchestra.run.smithi060:osd.9> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T07:31:11.759 INFO:tasks.cephadm:Deploying osd.10 on smithi123 with /dev/vg_nvme/lv_1... 2024-09-21T07:31:11.759 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:31:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:11.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:11 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:11.787 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:11.788 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:11.788 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:11 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:31:13.758 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:13 smithi123 ceph-mon[34166]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:13.942 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:13 smithi060 ceph-mon[31244]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:14.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:13 smithi187 ceph-mon[34367]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:14.261 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T07:31:14.064+0000 7f063d2c6640 -1 osd.9 0 log_to_monitors true 2024-09-21T07:31:14.435 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-21T07:31:14.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi123:vg_nvme/lv_1 2024-09-21T07:31:14.748 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:31:14.748 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:14.748 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:14.748 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.748 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.748 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.749 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.749 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:14.749 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:14.749 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:14 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:14.755 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:31:14.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:14.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:14 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:15.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:31:15.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:15.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:15.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:15.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:15.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:15.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:15.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:15.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:15.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:14 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:15.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 -- 172.21.15.123:0/1093125101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8103820 msgr2=0x7fd6c810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:15.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 --2- 172.21.15.123:0/1093125101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8103820 0x7fd6c810a1c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009ca0 tx=0x7fd6c002a950 comp rx=0 tx=0).stop 2024-09-21T07:31:15.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 -- 172.21.15.123:0/1093125101 shutdown_connections 2024-09-21T07:31:15.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 --2- 172.21.15.123:0/1093125101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8103820 0x7fd6c810a1c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:15.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 --2- 172.21.15.123:0/1093125101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c8102e80 0x7fd6c8103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:15.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 --2- 172.21.15.123:0/1093125101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8101df0 0x7fd6c8102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:15.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 -- 172.21.15.123:0/1093125101 >> 172.21.15.123:0/1093125101 conn(0x7fd6c80fd7a0 msgr2=0x7fd6c80ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:15.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 -- 172.21.15.123:0/1093125101 shutdown_connections 2024-09-21T07:31:15.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.270+0000 7fd6cf518640 1 -- 172.21.15.123:0/1093125101 wait complete. 2024-09-21T07:31:15.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 Processor -- start 2024-09-21T07:31:15.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 -- start start 2024-09-21T07:31:15.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 0x7fd6c81059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:15.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8102e80 0x7fd6c81042b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:15.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c8103820 0x7fd6c81047f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c810d210 con 0x7fd6c8103820 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c810d090 con 0x7fd6c8101df0 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cf518640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c810d390 con 0x7fd6c8102e80 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 0x7fd6c81059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 0x7fd6c81059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37690/0 (socket says 172.21.15.123:37690) 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 -- 172.21.15.123:0/3499051004 learned_addr learned my addr 172.21.15.123:0/3499051004 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cdab5640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c8103820 0x7fd6c81047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6ccab3640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8102e80 0x7fd6c81042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 -- 172.21.15.123:0/3499051004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8102e80 msgr2=0x7fd6c81042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8102e80 0x7fd6c81042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 -- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c8103820 msgr2=0x7fd6c81047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c8103820 0x7fd6c81047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:15.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6cd2b4640 1 -- 172.21.15.123:0/3499051004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8104ef0 con 0x7fd6c8101df0 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.271+0000 7fd6ccab3640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8102e80 0x7fd6c81042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.272+0000 7fd6cd2b4640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 0x7fd6c81059e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800b4a0 tx=0x7fd6b800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.272+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8014070 con 0x7fd6c8101df0 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.272+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c81a4060 con 0x7fd6c8101df0 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.272+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6b8010ac0 con 0x7fd6c8101df0 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.272+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8017c30 con 0x7fd6c8101df0 2024-09-21T07:31:15.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.272+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c81a4540 con 0x7fd6c8101df0 2024-09-21T07:31:15.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.273+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c81a47d0 con 0x7fd6c8101df0 2024-09-21T07:31:15.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.274+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd6b8017070 con 0x7fd6c8101df0 2024-09-21T07:31:15.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.275+0000 7fd6be7fc640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6b40b6510 0x7fd6b40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:15.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.275+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5965+0+0 (secure 0 0 0) 0x7fd6b80e6040 con 0x7fd6c8101df0 2024-09-21T07:31:15.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.275+0000 7fd6ccab3640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6b40b6510 0x7fd6b40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:15.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.276+0000 7fd6ccab3640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6b40b6510 0x7fd6b40b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40058c0 tx=0x7fd6c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:15.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.278+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6b80ad200 con 0x7fd6c8101df0 2024-09-21T07:31:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:15.472+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd6c8109ad0 con 0x7fd6b40b6510 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi060 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:31:15.991 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:31:15.992 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi060 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:31:16.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:16.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T07:31:15.648+0000 7f0639248640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T07:31:16.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T07:31:15.664+0000 7f0635046640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi060 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T07:31:16.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:16.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:31:16.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:31:16.123 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:16 smithi123 ceph-mon[34166]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:31:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:16 smithi123 ceph-mon[34166]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:31:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:16 smithi123 ceph-mon[34166]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:31:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:16 smithi187 ceph-mon[34367]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:31:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:16 smithi187 ceph-mon[34367]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:31:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:16 smithi187 ceph-mon[34367]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:31:17.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:17.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:17.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:16 smithi060 ceph-mon[31244]: from='client.24488 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:31:17.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:16 smithi060 ceph-mon[31244]: from='osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T07:31:17.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:16 smithi060 ceph-mon[31244]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:31:17.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:17.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:17 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:31:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:17 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:31:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:17 smithi123 ceph-mon[34166]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:17 smithi123 ceph-mon[34166]: osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] boot 2024-09-21T07:31:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:17 smithi123 ceph-mon[34166]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T07:31:17.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:17.921 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:17 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:31:17.921 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:17 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:31:17.921 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:17 smithi187 ceph-mon[34367]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:17.921 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:17 smithi187 ceph-mon[34367]: osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] boot 2024-09-21T07:31:17.921 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:17 smithi187 ceph-mon[34367]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T07:31:17.921 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:18.124 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:17 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:31:18.125 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:17 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:31:18.125 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:17 smithi060 ceph-mon[31244]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:31:18.125 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:17 smithi060 ceph-mon[31244]: osd.9 [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] boot 2024-09-21T07:31:18.125 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:17 smithi060 ceph-mon[31244]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T07:31:18.125 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/3898225882' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"} : dispatch 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"} : dispatch 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"}]': finished 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:18 smithi123 ceph-mon[34166]: from='client.? 172.21.15.123:0/2722479223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:31:19.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:31:19.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/3898225882' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"} : dispatch 2024-09-21T07:31:19.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"} : dispatch 2024-09-21T07:31:19.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"}]': finished 2024-09-21T07:31:19.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:31:19.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:19.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:18 smithi187 ceph-mon[34367]: from='client.? 172.21.15.123:0/2722479223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:31:19.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:31:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/3898225882' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"} : dispatch 2024-09-21T07:31:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"} : dispatch 2024-09-21T07:31:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd38d9d3-db87-467d-8eb8-30f7ef2d71ff"}]': finished 2024-09-21T07:31:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:31:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:19.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:18 smithi060 ceph-mon[31244]: from='client.? 172.21.15.123:0/2722479223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:31:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:19 smithi187 ceph-mon[34367]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:19 smithi123 ceph-mon[34166]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:19 smithi060 ceph-mon[31244]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:21 smithi187 ceph-mon[34367]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:21 smithi123 ceph-mon[34166]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:21 smithi060 ceph-mon[31244]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:24.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:23 smithi123 ceph-mon[34166]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:23 smithi187 ceph-mon[34367]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:23 smithi060 ceph-mon[31244]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:26.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:25 smithi123 ceph-mon[34166]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:25 smithi187 ceph-mon[34367]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:25 smithi060 ceph-mon[31244]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:27.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:31:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:27.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:31:27.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:27.292 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:31:27.293 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:27.986 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:27 smithi123 ceph-mon[34166]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:27.986 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:27 smithi123 ceph-mon[34166]: Deploying daemon osd.10 on smithi123 2024-09-21T07:31:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:27 smithi187 ceph-mon[34367]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:27 smithi187 ceph-mon[34367]: Deploying daemon osd.10 on smithi123 2024-09-21T07:31:28.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:27 smithi060 ceph-mon[31244]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:28.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:27 smithi060 ceph-mon[31244]: Deploying daemon osd.10 on smithi123 2024-09-21T07:31:30.228 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:29 smithi123 ceph-mon[34166]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:29 smithi187 ceph-mon[34367]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:29 smithi060 ceph-mon[31244]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:31 smithi187 ceph-mon[34367]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:32.306 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:31 smithi123 ceph-mon[34166]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:31 smithi060 ceph-mon[31244]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:33.233 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:33.233 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:33.233 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:33.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:33.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:33.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:33.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:33.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:33.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:34.149 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:33 smithi123 ceph-mon[34166]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:33 smithi187 ceph-mon[34367]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:33 smithi060 ceph-mon[31244]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:35.688 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 10 on host 'smithi123' 2024-09-21T07:31:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.686+0000 7fd6be7fc640 1 -- 172.21.15.123:0/3499051004 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd6c8109ad0 con 0x7fd6b40b6510 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6b40b6510 msgr2=0x7fd6b40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6b40b6510 0x7fd6b40b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40058c0 tx=0x7fd6c4005850 comp rx=0 tx=0).stop 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 msgr2=0x7fd6c81059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 0x7fd6c81059e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6b800b4a0 tx=0x7fd6b800b960 comp rx=0 tx=0).stop 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 shutdown_connections 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6b40b6510 0x7fd6b40b8a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c8103820 0x7fd6c81047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c8102e80 0x7fd6c81042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 --2- 172.21.15.123:0/3499051004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6c8101df0 0x7fd6c81059e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:35.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 >> 172.21.15.123:0/3499051004 conn(0x7fd6c80fd7a0 msgr2=0x7fd6c81083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:35.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 shutdown_connections 2024-09-21T07:31:35.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-21T07:31:35.689+0000 7fd6cf518640 1 -- 172.21.15.123:0/3499051004 wait complete. 2024-09-21T07:31:36.250 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:35 smithi123 ceph-mon[34166]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:36.251 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:35 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:35 smithi187 ceph-mon[34367]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:35 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:36.278 DEBUG:teuthology.orchestra.run.smithi123:osd.10> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T07:31:36.280 INFO:tasks.cephadm:Deploying osd.11 on smithi187 with /dev/vg_nvme/lv_1... 2024-09-21T07:31:36.280 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:31:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:35 smithi060 ceph-mon[31244]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:36.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:35 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:36.541 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:31:37.710 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:37.710 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:37.710 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:37 smithi187 ceph-mon[34367]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:37.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:37.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:37.757 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:37 smithi123 ceph-mon[34166]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:37.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:37.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:37.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:37 smithi060 ceph-mon[31244]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:38.527 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:38 smithi187 ceph-mon[34367]: from='osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:31:38.527 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:38 smithi187 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:31:38.717 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:38 smithi123 ceph-mon[34166]: from='osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:31:38.717 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:38 smithi123 ceph-mon[34166]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:31:38.717 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 07:31:38 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T07:31:38.395+0000 7fd002a79640 -1 osd.10 0 log_to_monitors true 2024-09-21T07:31:38.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:38 smithi060 ceph-mon[31244]: from='osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:31:38.920 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:38 smithi060 ceph-mon[31244]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:31:39.162 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-21T07:31:39.189 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi187:vg_nvme/lv_1 2024-09-21T07:31:39.442 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:31:39.714 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:39 smithi187 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:31:39.714 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:39 smithi187 ceph-mon[34367]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:31:39.714 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:39 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:39.714 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:39 smithi187 ceph-mon[34367]: from='osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:31:39.715 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:39 smithi187 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:31:39.715 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:39 smithi187 ceph-mon[34367]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:39.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T07:31:39.457+0000 7fcffe9fb640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T07:31:39.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T07:31:39.471+0000 7fcffa7f9640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:31:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-mon[34166]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:31:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-mon[34166]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:31:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-mon[34166]: from='osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:31:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-mon[34166]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:31:39.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:39 smithi123 ceph-mon[34166]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:39.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:39 smithi060 ceph-mon[31244]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:31:39.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:39 smithi060 ceph-mon[31244]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:31:39.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:39 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:39.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:39 smithi060 ceph-mon[31244]: from='osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:31:39.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:39 smithi060 ceph-mon[31244]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]} : dispatch 2024-09-21T07:31:39.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:39 smithi060 ceph-mon[31244]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:39.907 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.903+0000 7f95e39d3640 1 -- 172.21.15.187:0/40220575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc1040a0 msgr2=0x7f95dc10aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.907 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.903+0000 7f95e39d3640 1 --2- 172.21.15.187:0/40220575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc1040a0 0x7f95dc10aa40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95d4009ca0 tx=0x7f95d402a950 comp rx=0 tx=0).stop 2024-09-21T07:31:39.907 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 -- 172.21.15.187:0/40220575 shutdown_connections 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 --2- 172.21.15.187:0/40220575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc1040a0 0x7f95dc10aa40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 --2- 172.21.15.187:0/40220575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95dc103700 0x7f95dc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 --2- 172.21.15.187:0/40220575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95dc102670 0x7f95dc102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 -- 172.21.15.187:0/40220575 >> 172.21.15.187:0/40220575 conn(0x7f95dc0fdfe0 msgr2=0x7f95dc100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 -- 172.21.15.187:0/40220575 shutdown_connections 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 -- 172.21.15.187:0/40220575 wait complete. 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 Processor -- start 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 -- start start 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95dc102670 0x7f95dc199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 0x7f95dc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.904+0000 7f95e39d3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95dc1040a0 0x7f95dc19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e39d3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc10e2c0 con 0x7f95dc1040a0 2024-09-21T07:31:39.908 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e39d3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc10e140 con 0x7f95dc102670 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e39d3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc10e440 con 0x7f95dc103700 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 0x7f95dc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 0x7f95dc19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:39872/0 (socket says 172.21.15.187:39872) 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 -- 172.21.15.187:0/1511624207 learned_addr learned my addr 172.21.15.187:0/1511624207 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e176f640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95dc102670 0x7f95dc199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e1f70640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95dc1040a0 0x7f95dc19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 -- 172.21.15.187:0/1511624207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95dc102670 msgr2=0x7f95dc199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95dc102670 0x7f95dc199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 -- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95dc1040a0 msgr2=0x7f95dc19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95dc1040a0 0x7f95dc19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 -- 172.21.15.187:0/1511624207 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc19b960 con 0x7f95dc103700 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e0f6e640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 0x7f95dc19a630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c920 tx=0x7f95d800cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8007c70 con 0x7f95dc103700 2024-09-21T07:31:39.909 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc19bc50 con 0x7f95dc103700 2024-09-21T07:31:39.910 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95d8007e10 con 0x7f95dc103700 2024-09-21T07:31:39.910 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8018820 con 0x7f95dc103700 2024-09-21T07:31:39.910 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.905+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc1a23e0 con 0x7f95dc103700 2024-09-21T07:31:39.911 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.907+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95dc1a25b0 con 0x7f95dc103700 2024-09-21T07:31:39.911 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.908+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f95d800f450 con 0x7f95dc103700 2024-09-21T07:31:39.911 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.909+0000 7f95ce7fc640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f95c80b6510 0x7f95c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:31:39.911 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.909+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6414+0+0 (secure 0 0 0) 0x7f95d80e6c30 con 0x7f95dc103700 2024-09-21T07:31:39.911 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.909+0000 7f95e176f640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f95c80b6510 0x7f95c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:31:39.911 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.909+0000 7f95e176f640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f95c80b6510 0x7f95c80b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009bd0 tx=0x7f95d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:31:39.914 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:39.913+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95d8014030 con 0x7f95dc103700 2024-09-21T07:31:40.103 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:31:40.101+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f95dc0fffb0 con 0x7f95c80b6510 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi123 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:40.706 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:40.707 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.708 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:40.708 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.708 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:31:40.708 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:31:40.708 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:31:40.708 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi123 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:40.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:40.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:31:40.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:31:40.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:31:40.851 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi123 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi123 to 4272M 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:31:40.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:31:40.874 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:31:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:31:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] boot 2024-09-21T07:31:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:31:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:41.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:41 smithi187 ceph-mon[34367]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] boot 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:41.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:41 smithi123 ceph-mon[34166]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:41.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:31:41.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:31:41.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:41.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: osd.10 [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] boot 2024-09-21T07:31:41.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:31:41.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:31:41.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:41 smithi060 ceph-mon[31244]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:31:42.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:42 smithi187 ceph-mon[34367]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:31:42.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:42 smithi123 ceph-mon[34166]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:31:42.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:42 smithi060 ceph-mon[31244]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:31:43.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:31:43.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/908202140' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"} : dispatch 2024-09-21T07:31:43.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"} : dispatch 2024-09-21T07:31:43.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"}]': finished 2024-09-21T07:31:43.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:31:43.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:31:43.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:31:43.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:43 smithi187 ceph-mon[34367]: from='client.? 172.21.15.187:0/105757674' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/908202140' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"} : dispatch 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"} : dispatch 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"}]': finished 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:31:43.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:43 smithi123 ceph-mon[34166]: from='client.? 172.21.15.187:0/105757674' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:31:43.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T07:31:43.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/908202140' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"} : dispatch 2024-09-21T07:31:43.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"} : dispatch 2024-09-21T07:31:43.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebf88bac-fc34-49b0-b0ac-4a2ab1040524"}]': finished 2024-09-21T07:31:43.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:31:43.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:31:43.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:31:43.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:43 smithi060 ceph-mon[31244]: from='client.? 172.21.15.187:0/105757674' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:31:45.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:45 smithi060 ceph-mon[31244]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-21T07:31:46.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:45 smithi187 ceph-mon[34367]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-21T07:31:46.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:45 smithi123 ceph-mon[34166]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-21T07:31:47.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:47 smithi187 ceph-mon[34367]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:31:47.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:47 smithi060 ceph-mon[31244]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:31:47.901 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:47 smithi123 ceph-mon[34166]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:31:49.723 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:49 smithi187 ceph-mon[34367]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T07:31:49.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:49 smithi060 ceph-mon[31244]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T07:31:50.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:49 smithi123 ceph-mon[34166]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T07:31:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:51 smithi187 ceph-mon[34367]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:31:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:31:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:51 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:51 smithi187 ceph-mon[34367]: Deploying daemon osd.11 on smithi187 2024-09-21T07:31:51.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:51 smithi060 ceph-mon[31244]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:31:51.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:31:51.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:51 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:51.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:51 smithi060 ceph-mon[31244]: Deploying daemon osd.11 on smithi187 2024-09-21T07:31:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:51 smithi123 ceph-mon[34166]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:31:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:31:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:51 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:31:52.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:51 smithi123 ceph-mon[34166]: Deploying daemon osd.11 on smithi187 2024-09-21T07:31:53.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:53 smithi060 ceph-mon[31244]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:31:53.893 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:53 smithi187 ceph-mon[34367]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:31:54.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:53 smithi123 ceph-mon[34166]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:31:55.721 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:55 smithi187 ceph-mon[34367]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:56.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:55 smithi123 ceph-mon[34166]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:56.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:55 smithi060 ceph-mon[31244]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:31:57.654 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:57 smithi187 ceph-mon[34367]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:31:57.654 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:57.654 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:57.654 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:57 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:57.924 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:57 smithi060 ceph-mon[31244]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:31:57.924 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:57.924 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:57.924 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:57 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:58.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:57 smithi123 ceph-mon[34166]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:31:58.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:31:58.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:58.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:57 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:31:59.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:31:59 smithi187 ceph-mon[34367]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:00.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:31:59 smithi123 ceph-mon[34166]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:31:59 smithi060 ceph-mon[31244]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:00.581 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 11 on host 'smithi187' 2024-09-21T07:32:00.581 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.579+0000 7f95ce7fc640 1 -- 172.21.15.187:0/1511624207 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f95dc0fffb0 con 0x7f95c80b6510 2024-09-21T07:32:00.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f95c80b6510 msgr2=0x7f95c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:00.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f95c80b6510 0x7f95c80b8a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009bd0 tx=0x7f95d0005f90 comp rx=0 tx=0).stop 2024-09-21T07:32:00.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 msgr2=0x7f95dc19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:00.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 0x7f95dc19a630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c920 tx=0x7f95d800cde0 comp rx=0 tx=0).stop 2024-09-21T07:32:00.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 shutdown_connections 2024-09-21T07:32:00.583 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f95c80b6510 0x7f95c80b8a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:00.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95dc1040a0 0x7f95dc19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:00.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95dc103700 0x7f95dc19a630 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:00.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 --2- 172.21.15.187:0/1511624207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95dc102670 0x7f95dc199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:00.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.581+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 >> 172.21.15.187:0/1511624207 conn(0x7f95dc0fdfe0 msgr2=0x7f95dc0ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:00.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.582+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 shutdown_connections 2024-09-21T07:32:00.584 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:00.582+0000 7f95e39d3640 1 -- 172.21.15.187:0/1511624207 wait complete. 2024-09-21T07:32:00.933 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:00.933 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:00.933 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:00.933 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:00.933 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:00.934 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:00.934 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:00.934 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:00 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:00 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:00 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:01.236 DEBUG:teuthology.orchestra.run.smithi187:osd.11> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T07:32:01.238 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T07:32:01.239 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:32:01.509 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:01.881 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:01 smithi060 ceph-mon[31244]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.974+0000 7f19e00c6640 1 -- 172.21.15.60:0/1577306137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d8104070 msgr2=0x7f19d810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.974+0000 7f19e00c6640 1 --2- 172.21.15.60:0/1577306137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d8104070 0x7f19d810aa10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009ca0 tx=0x7f19d002a950 comp rx=0 tx=0).stop 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.974+0000 7f19e00c6640 1 -- 172.21.15.60:0/1577306137 shutdown_connections 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.974+0000 7f19e00c6640 1 --2- 172.21.15.60:0/1577306137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d8104070 0x7f19d810aa10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.975+0000 7f19e00c6640 1 --2- 172.21.15.60:0/1577306137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d81036d0 0x7f19d8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.975+0000 7f19e00c6640 1 --2- 172.21.15.60:0/1577306137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d8102640 0x7f19d8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.975+0000 7f19e00c6640 1 -- 172.21.15.60:0/1577306137 >> 172.21.15.60:0/1577306137 conn(0x7f19d80fdfb0 msgr2=0x7f19d8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:01.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.975+0000 7f19e00c6640 1 -- 172.21.15.60:0/1577306137 shutdown_connections 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.975+0000 7f19e00c6640 1 -- 172.21.15.60:0/1577306137 wait complete. 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 Processor -- start 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 -- start start 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d8102640 0x7f19d8198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 0x7f19d81994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d8104070 0x7f19d819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19d810e270 con 0x7f19d81036d0 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19d810e0f0 con 0x7f19d8104070 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19e00c6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f19d810e3f0 con 0x7f19d8102640 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 0x7f19d81994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 0x7f19d81994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49826/0 (socket says 172.21.15.60:49826) 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 -- 172.21.15.60:0/2822773392 learned_addr learned my addr 172.21.15.60:0/2822773392 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:01.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dde62640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d8102640 0x7f19d8198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19de663640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d8104070 0x7f19d819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 -- 172.21.15.60:0/2822773392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d8102640 msgr2=0x7f19d8198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d8102640 0x7f19d8198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 -- 172.21.15.60:0/2822773392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d8104070 msgr2=0x7f19d819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d8104070 0x7f19d819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19dd661640 1 -- 172.21.15.60:0/2822773392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d819a890 con 0x7f19d81036d0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.976+0000 7f19de663640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d8104070 0x7f19d819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.977+0000 7f19dd661640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 0x7f19d81994d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f19c800d950 tx=0x7f19c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.977+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8017030 con 0x7f19d81036d0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.977+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d819ab80 con 0x7f19d81036d0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.977+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19c8004020 con 0x7f19d81036d0 2024-09-21T07:32:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.977+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c80047a0 con 0x7f19d81036d0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.977+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81a1280 con 0x7f19d81036d0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.978+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d8109800 con 0x7f19d81036d0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.980+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f19c8009a30 con 0x7f19d81036d0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.981+0000 7f19ceffd640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f19c40b6510 0x7f19c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.981+0000 7f19dde62640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f19c40b6510 0x7f19c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.981+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7f19c80e6e60 con 0x7f19d81036d0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.981+0000 7f19dde62640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f19c40b6510 0x7f19c40b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009bd0 tx=0x7f19d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:02.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:01.984+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19c80adc30 con 0x7f19d81036d0 2024-09-21T07:32:02.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:01 smithi187 ceph-mon[34367]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:01 smithi123 ceph-mon[34166]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:02.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.172+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f19d802e810 con 0x7f19d81036d0 2024-09-21T07:32:02.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.172+0000 7f19ceffd640 1 -- 172.21.15.60:0/2822773392 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f19c80b2010 con 0x7f19d81036d0 2024-09-21T07:32:02.174 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:02.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.174+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f19c40b6510 msgr2=0x7f19c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.174+0000 7f19e00c6640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f19c40b6510 0x7f19c40b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009bd0 tx=0x7f19d4005f90 comp rx=0 tx=0).stop 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.174+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 msgr2=0x7f19d81994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.174+0000 7f19e00c6640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 0x7f19d81994d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f19c800d950 tx=0x7f19c800de10 comp rx=0 tx=0).stop 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 shutdown_connections 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f19c40b6510 0x7f19c40b8a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19d8104070 0x7f19d819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19d81036d0 0x7f19d81994d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 --2- 172.21.15.60:0/2822773392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d8102640 0x7f19d8198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 >> 172.21.15.60:0/2822773392 conn(0x7f19d80fdfb0 msgr2=0x7f19d81069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 shutdown_connections 2024-09-21T07:32:02.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:02.175+0000 7f19e00c6640 1 -- 172.21.15.60:0/2822773392 wait complete. 2024-09-21T07:32:02.911 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:02 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2822773392' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:02.912 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726903900,"num_in_osds":12,"osd_in_since":1726903902,"num_remapped_pgs":0} 2024-09-21T07:32:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:02 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2822773392' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:03.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:02 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2822773392' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:03.455 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 07:32:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T07:32:03.053+0000 7f4d7cc3d640 -1 osd.11 0 log_to_monitors true 2024-09-21T07:32:03.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:32:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:03 smithi123 ceph-mon[34166]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:04.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:03 smithi123 ceph-mon[34166]: from='osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:32:04.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:03 smithi123 ceph-mon[34166]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:32:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:03 smithi060 ceph-mon[31244]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:03 smithi060 ceph-mon[31244]: from='osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:32:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:03 smithi060 ceph-mon[31244]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:32:04.156 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:03 smithi187 ceph-mon[34367]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:04.156 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:03 smithi187 ceph-mon[34367]: from='osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:32:04.156 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:03 smithi187 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:32:04.184 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 -- 172.21.15.60:0/3170415640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557006c5e0 msgr2=0x7f5570106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 --2- 172.21.15.60:0/3170415640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557006c5e0 0x7f5570106420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f556c009900 tx=0x7f556c02a410 comp rx=0 tx=0).stop 2024-09-21T07:32:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 -- 172.21.15.60:0/3170415640 shutdown_connections 2024-09-21T07:32:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 --2- 172.21.15.60:0/3170415640 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55701094a0 0x7f557010b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 --2- 172.21.15.60:0/3170415640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5570106960 0x7f5570108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 --2- 172.21.15.60:0/3170415640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f557006c5e0 0x7f5570106420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.705+0000 7f557742b640 1 -- 172.21.15.60:0/3170415640 >> 172.21.15.60:0/3170415640 conn(0x7f55700fdfe0 msgr2=0x7f5570100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.706+0000 7f557742b640 1 -- 172.21.15.60:0/3170415640 shutdown_connections 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.706+0000 7f557742b640 1 -- 172.21.15.60:0/3170415640 wait complete. 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.706+0000 7f557742b640 1 Processor -- start 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.706+0000 7f557742b640 1 -- start start 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.706+0000 7f557742b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f557006c5e0 0x7f557019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f557742b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 0x7f557019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f557742b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55701094a0 0x7f557019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f557742b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f557010f460 con 0x7f5570106960 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f557742b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f557010f2e0 con 0x7f55701094a0 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f557742b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f557010f5e0 con 0x7f557006c5e0 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 0x7f557019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 0x7f557019a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49844/0 (socket says 172.21.15.60:49844) 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55751c7640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f557006c5e0 0x7f557019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 -- 172.21.15.60:0/3528663169 learned_addr learned my addr 172.21.15.60:0/3528663169 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55759c8640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55701094a0 0x7f557019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 -- 172.21.15.60:0/3528663169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f557006c5e0 msgr2=0x7f557019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f557006c5e0 0x7f557019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 -- 172.21.15.60:0/3528663169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55701094a0 msgr2=0x7f557019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55701094a0 0x7f557019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 -- 172.21.15.60:0/3528663169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557019bb40 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55751c7640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f557006c5e0 0x7f557019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55759c8640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55701094a0 0x7f557019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55749c6640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 0x7f557019a780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f556000b4a0 tx=0x7f556000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.707+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560014070 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.708+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5560010ac0 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.708+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557019be30 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.708+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560017c30 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.708+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55701a2530 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.709+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55700ffb00 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.710+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5560017070 con 0x7f5570106960 2024-09-21T07:32:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.711+0000 7f55667fc640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f555c0b6510 0x7f555c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.711+0000 7f55751c7640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f555c0b6510 0x7f555c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.711+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6831+0+0 (secure 0 0 0) 0x7f55600e6310 con 0x7f5570106960 2024-09-21T07:32:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.711+0000 7f55751c7640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f555c0b6510 0x7f555c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f556c000c00 tx=0x7f556c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.714+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55600ad170 con 0x7f5570106960 2024-09-21T07:32:04.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: Detected new or changed devices on smithi187 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi187 to 4272M 2024-09-21T07:32:04.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:04.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:04.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:04.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.912+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5570063fc0 con 0x7f5570106960 2024-09-21T07:32:04.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.913+0000 7f55667fc640 1 -- 172.21.15.60:0/3528663169 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f55600b1550 con 0x7f5570106960 2024-09-21T07:32:04.915 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f555c0b6510 msgr2=0x7f555c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f555c0b6510 0x7f555c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f556c000c00 tx=0x7f556c031400 comp rx=0 tx=0).stop 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 msgr2=0x7f557019a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 0x7f557019a780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f556000b4a0 tx=0x7f556000b960 comp rx=0 tx=0).stop 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 shutdown_connections 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f555c0b6510 0x7f555c0b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55701094a0 0x7f557019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5570106960 0x7f557019a780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 --2- 172.21.15.60:0/3528663169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f557006c5e0 0x7f557019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 >> 172.21.15.60:0/3528663169 conn(0x7f55700fdfe0 msgr2=0x7f5570104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:04.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 shutdown_connections 2024-09-21T07:32:04.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:04.915+0000 7f557742b640 1 -- 172.21.15.60:0/3528663169 wait complete. 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: Detected new or changed devices on smithi187 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi187 to 4272M 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:05.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:32:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:32:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: Detected new or changed devices on smithi187 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi187 to 4272M 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:05.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:05.662 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726903900,"num_in_osds":12,"osd_in_since":1726903902,"num_remapped_pgs":0} 2024-09-21T07:32:06.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:06.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:32:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:32:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3528663169' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:06.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-mon[34367]: from='osd.11 ' entity='osd.11' 2024-09-21T07:32:06.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T07:32:05.685+0000 7f4d78bbf640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T07:32:06.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 07:32:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T07:32:05.832+0000 7f4d709b5640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3528663169' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:05 smithi123 ceph-mon[34166]: from='osd.11 ' entity='osd.11' 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3528663169' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:06.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:05 smithi060 ceph-mon[31244]: from='osd.11 ' entity='osd.11' 2024-09-21T07:32:06.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:32:06.937 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:07.058 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:06 smithi060 ceph-mon[31244]: purged_snaps scrub starts 2024-09-21T07:32:07.058 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:06 smithi060 ceph-mon[31244]: purged_snaps scrub ok 2024-09-21T07:32:07.058 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:07.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:06 smithi123 ceph-mon[34166]: purged_snaps scrub starts 2024-09-21T07:32:07.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:06 smithi123 ceph-mon[34166]: purged_snaps scrub ok 2024-09-21T07:32:07.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:07.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:06 smithi187 ceph-mon[34367]: purged_snaps scrub starts 2024-09-21T07:32:07.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:06 smithi187 ceph-mon[34367]: purged_snaps scrub ok 2024-09-21T07:32:07.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:07.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 -- 172.21.15.60:0/2348963317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 msgr2=0x7f2bf410aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 --2- 172.21.15.60:0/2348963317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf410aa40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009900 tx=0x7f2be402a480 comp rx=0 tx=0).stop 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 -- 172.21.15.60:0/2348963317 shutdown_connections 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 --2- 172.21.15.60:0/2348963317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf410aa40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 --2- 172.21.15.60:0/2348963317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4103700 0x7f2bf4103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 --2- 172.21.15.60:0/2348963317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf4102670 0x7f2bf4102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.403+0000 7f2bf9610640 1 -- 172.21.15.60:0/2348963317 >> 172.21.15.60:0/2348963317 conn(0x7f2bf40fdfe0 msgr2=0x7f2bf4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.404+0000 7f2bf9610640 1 -- 172.21.15.60:0/2348963317 shutdown_connections 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.404+0000 7f2bf9610640 1 -- 172.21.15.60:0/2348963317 wait complete. 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.404+0000 7f2bf9610640 1 Processor -- start 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.404+0000 7f2bf9610640 1 -- start start 2024-09-21T07:32:07.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf9610640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf4102670 0x7f2bf4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf9610640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4103700 0x7f2bf419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf9610640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf9610640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410e2a0 con 0x7f2bf41040a0 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf9610640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410e120 con 0x7f2bf4102670 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf9610640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410e420 con 0x7f2bf4103700 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf419b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45684/0 (socket says 172.21.15.60:45684) 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf4102670 0x7f2bf4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 -- 172.21.15.60:0/976865244 learned_addr learned my addr 172.21.15.60:0/976865244 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf27fc640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4103700 0x7f2bf419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 -- 172.21.15.60:0/976865244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4103700 msgr2=0x7f2bf419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:07.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4103700 0x7f2bf419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 -- 172.21.15.60:0/976865244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf4102670 msgr2=0x7f2bf4199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf4102670 0x7f2bf4199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 -- 172.21.15.60:0/976865244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf419b960 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.405+0000 7f2bf37fe640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf419b1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009230 tx=0x7f2be4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.406+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be403f030 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.406+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf419bbf0 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.406+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2be4003aa0 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.406+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4035070 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.406+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41a2210 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.407+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf4102ae0 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.409+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2be4042030 con 0x7f2bf41040a0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.410+0000 7f2bebfff640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2be00b6510 0x7f2be00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.410+0000 7f2bf2ffd640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2be00b6510 0x7f2be00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:07.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.410+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f2be41078f0 con 0x7f2bf41040a0 2024-09-21T07:32:07.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.410+0000 7f2bf2ffd640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2be00b6510 0x7f2be00b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2bec005fd0 tx=0x7f2bec009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:07.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.413+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2be40ce620 con 0x7f2bf41040a0 2024-09-21T07:32:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.603+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2bf41a2500 con 0x7f2bf41040a0 2024-09-21T07:32:07.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.603+0000 7f2bebfff640 1 -- 172.21.15.60:0/976865244 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f2be40d2a00 con 0x7f2bf41040a0 2024-09-21T07:32:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.605+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2be00b6510 msgr2=0x7f2be00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.605+0000 7f2bf9610640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2be00b6510 0x7f2be00b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2bec005fd0 tx=0x7f2bec009680 comp rx=0 tx=0).stop 2024-09-21T07:32:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.605+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 msgr2=0x7f2bf419b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf419b1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009230 tx=0x7f2be4031a50 comp rx=0 tx=0).stop 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 shutdown_connections 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2be00b6510 0x7f2be00b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41040a0 0x7f2bf419b1d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bf4103700 0x7f2bf419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 --2- 172.21.15.60:0/976865244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bf4102670 0x7f2bf4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 >> 172.21.15.60:0/976865244 conn(0x7f2bf40fdfe0 msgr2=0x7f2bf40ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 shutdown_connections 2024-09-21T07:32:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:07.606+0000 7f2bf9610640 1 -- 172.21.15.60:0/976865244 wait complete. 2024-09-21T07:32:07.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:07 smithi060 ceph-mon[31244]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:07.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:07 smithi060 ceph-mon[31244]: osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] boot 2024-09-21T07:32:07.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:07 smithi060 ceph-mon[31244]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:32:07.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:07.873 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:07 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/976865244' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:08.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:07 smithi123 ceph-mon[34166]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:08.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:07 smithi123 ceph-mon[34166]: osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] boot 2024-09-21T07:32:08.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:07 smithi123 ceph-mon[34166]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:32:08.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:07 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:08.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:07 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/976865244' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:07 smithi187 ceph-mon[34367]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:32:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:07 smithi187 ceph-mon[34367]: osd.11 [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] boot 2024-09-21T07:32:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:07 smithi187 ceph-mon[34367]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:32:08.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:07 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:32:08.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:07 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/976865244' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:32:08.300 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726903926,"num_in_osds":12,"osd_in_since":1726903902,"num_remapped_pgs":0} 2024-09-21T07:32:08.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:32:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:08.996 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:08 smithi060 ceph-mon[31244]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:32:09.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 -- 172.21.15.60:0/386447694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c108d10 msgr2=0x7ff01c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:09.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 --2- 172.21.15.60:0/386447694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c108d10 0x7ff01c10f540 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff014009ca0 tx=0x7ff01402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 -- 172.21.15.60:0/386447694 shutdown_connections 2024-09-21T07:32:09.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 --2- 172.21.15.60:0/386447694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c108d10 0x7ff01c10f540 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 --2- 172.21.15.60:0/386447694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff01c1083c0 0x7ff01c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 --2- 172.21.15.60:0/386447694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff01c102a80 0x7ff01c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 -- 172.21.15.60:0/386447694 >> 172.21.15.60:0/386447694 conn(0x7ff01c079740 msgr2=0x7ff01c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 -- 172.21.15.60:0/386447694 shutdown_connections 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.994+0000 7ff023720640 1 -- 172.21.15.60:0/386447694 wait complete. 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 Processor -- start 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 -- start start 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 0x7ff01c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff01c1083c0 0x7ff01c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff01c108d10 0x7ff01c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c112980 con 0x7ff01c102a80 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c112800 con 0x7ff01c108d10 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff023720640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c112b00 con 0x7ff01c1083c0 2024-09-21T07:32:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff0214bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 0x7ff01c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff0214bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 0x7ff01c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45714/0 (socket says 172.21.15.60:45714) 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.995+0000 7ff0214bc640 1 -- 172.21.15.60:0/1247241951 learned_addr learned my addr 172.21.15.60:0/1247241951 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0214bc640 1 -- 172.21.15.60:0/1247241951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff01c1083c0 msgr2=0x7ff01c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0214bc640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff01c1083c0 0x7ff01c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0214bc640 1 -- 172.21.15.60:0/1247241951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff01c108d10 msgr2=0x7ff01c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff021cbd640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff01c108d10 0x7ff01c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0214bc640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff01c108d10 0x7ff01c19fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0214bc640 1 -- 172.21.15.60:0/1247241951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c1a03b0 con 0x7ff01c102a80 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0214bc640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 0x7ff01c19a440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff01800d770 tx=0x7ff01800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018017070 con 0x7ff01c102a80 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0180054d0 con 0x7ff01c102a80 2024-09-21T07:32:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c1a06a0 con 0x7ff01c102a80 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018004c30 con 0x7ff01c102a80 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.996+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c1a6e00 con 0x7ff01c102a80 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.997+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c103d00 con 0x7ff01c102a80 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.999+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff018004dd0 con 0x7ff01c102a80 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.999+0000 7ff0127fc640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff0080b6510 0x7ff0080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:08.999+0000 7ff020cbb640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff0080b6510 0x7ff0080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.000+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7ff0180e6da0 con 0x7ff01c102a80 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.000+0000 7ff020cbb640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff0080b6510 0x7ff0080b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff00c005fd0 tx=0x7ff00c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.002+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0180adad0 con 0x7ff01c102a80 2024-09-21T07:32:09.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:08 smithi123 ceph-mon[34166]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:32:09.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.190+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff01c102e90 con 0x7ff01c102a80 2024-09-21T07:32:09.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.191+0000 7ff0127fc640 1 -- 172.21.15.60:0/1247241951 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18455 (secure 0 0 0) 0x7ff0180b1eb0 con 0x7ff01c102a80 2024-09-21T07:32:09.193 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:09.193 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":69,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:32:07.810674+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:09.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff0080b6510 msgr2=0x7ff0080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:09.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff0080b6510 0x7ff0080b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff00c005fd0 tx=0x7ff00c005850 comp rx=0 tx=0).stop 2024-09-21T07:32:09.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 msgr2=0x7ff01c19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 0x7ff01c19a440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff01800d770 tx=0x7ff01800dc30 comp rx=0 tx=0).stop 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 shutdown_connections 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff0080b6510 0x7ff0080b8a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff01c108d10 0x7ff01c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff01c1083c0 0x7ff01c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 --2- 172.21.15.60:0/1247241951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c102a80 0x7ff01c19a440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 >> 172.21.15.60:0/1247241951 conn(0x7ff01c079740 msgr2=0x7ff01c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.193+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 shutdown_connections 2024-09-21T07:32:09.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:09.194+0000 7ff023720640 1 -- 172.21.15.60:0/1247241951 wait complete. 2024-09-21T07:32:09.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:08 smithi187 ceph-mon[34367]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:32:09.838 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:28:22.984982+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:32:09.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:32:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:09 smithi123 ceph-mon[34166]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:09 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1247241951' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:10.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:09 smithi060 ceph-mon[31244]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:10.188 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:09 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1247241951' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:09 smithi187 ceph-mon[34367]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:09 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1247241951' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 -- 172.21.15.60:0/2494730201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c1094c0 msgr2=0x7fdc9c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 --2- 172.21.15.60:0/2494730201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c1094c0 0x7fdc9c1098d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009900 tx=0x7fdc9002a410 comp rx=0 tx=0).stop 2024-09-21T07:32:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 -- 172.21.15.60:0/2494730201 shutdown_connections 2024-09-21T07:32:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 --2- 172.21.15.60:0/2494730201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc9c109e10 0x7fdc9c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 --2- 172.21.15.60:0/2494730201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c1094c0 0x7fdc9c1098d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 --2- 172.21.15.60:0/2494730201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc9c103b80 0x7fdc9c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 -- 172.21.15.60:0/2494730201 >> 172.21.15.60:0/2494730201 conn(0x7fdc9c0ff610 msgr2=0x7fdc9c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 -- 172.21.15.60:0/2494730201 shutdown_connections 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.554+0000 7fdca3a94640 1 -- 172.21.15.60:0/2494730201 wait complete. 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 Processor -- start 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 -- start start 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc9c103b80 0x7fdc9c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc9c1094c0 0x7fdc9c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 0x7fdc9c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c113ad0 con 0x7fdc9c109e10 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c113950 con 0x7fdc9c103b80 2024-09-21T07:32:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca3a94640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c113c50 con 0x7fdc9c1094c0 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 0x7fdc9c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 0x7fdc9c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45730/0 (socket says 172.21.15.60:45730) 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 -- 172.21.15.60:0/106233955 learned_addr learned my addr 172.21.15.60:0/106233955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca1830640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc9c103b80 0x7fdc9c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca102f640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc9c1094c0 0x7fdc9c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 -- 172.21.15.60:0/106233955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc9c1094c0 msgr2=0x7fdc9c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc9c1094c0 0x7fdc9c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 -- 172.21.15.60:0/106233955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc9c103b80 msgr2=0x7fdc9c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.555+0000 7fdca2031640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc9c103b80 0x7fdc9c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdca2031640 1 -- 172.21.15.60:0/106233955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1a0410 con 0x7fdc9c109e10 2024-09-21T07:32:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdca2031640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 0x7fdc9c19fce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00eaa0 tx=0x7fdc8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00cdb0 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc8c005020 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c1a0700 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0116d0 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.556+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1a6e60 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.557+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c104e00 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.559+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdc8c0051d0 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.560+0000 7fdc9affd640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdc840b6510 0x7fdc840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.560+0000 7fdca1830640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdc840b6510 0x7fdc840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.560+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fdc8c0e7490 con 0x7fdc9c109e10 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.560+0000 7fdca1830640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdc840b6510 0x7fdc840b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc940058c0 tx=0x7fdc9400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.563+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc8c016030 con 0x7fdc9c109e10 2024-09-21T07:32:10.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.754+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc9c02e640 con 0x7fdc9c109e10 2024-09-21T07:32:10.757 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-21T07:32:10.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.755+0000 7fdc9affd640 1 -- 172.21.15.60:0/106233955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7fdc8c0ae1c0 con 0x7fdc9c109e10 2024-09-21T07:32:10.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdc840b6510 msgr2=0x7fdc840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdc840b6510 0x7fdc840b8a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc940058c0 tx=0x7fdc9400a4c0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 msgr2=0x7fdc9c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 0x7fdc9c19fce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00eaa0 tx=0x7fdc8c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 shutdown_connections 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdc840b6510 0x7fdc840b8a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc9c109e10 0x7fdc9c19fce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc9c1094c0 0x7fdc9c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 --2- 172.21.15.60:0/106233955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc9c103b80 0x7fdc9c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 >> 172.21.15.60:0/106233955 conn(0x7fdc9c0ff610 msgr2=0x7fdc9c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 shutdown_connections 2024-09-21T07:32:10.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:10.758+0000 7fdca3a94640 1 -- 172.21.15.60:0/106233955 wait complete. 2024-09-21T07:32:11.055 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:10 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/106233955' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:32:11.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:10 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/106233955' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:32:11.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:10 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/106233955' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:32:11.370 INFO:tasks.cephadm:Adding mds.a on smithi060 2024-09-21T07:32:11.370 INFO:tasks.cephadm:Adding mds.d on smithi060 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.g on smithi060 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.j on smithi060 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.b on smithi123 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.e on smithi123 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.h on smithi123 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.k on smithi123 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.c on smithi187 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.f on smithi187 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.i on smithi187 2024-09-21T07:32:11.371 INFO:tasks.cephadm:Adding mds.l on smithi187 2024-09-21T07:32:11.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l' 2024-09-21T07:32:11.634 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:32:12.017 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:11 smithi187 ceph-mon[34367]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:12.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:11 smithi123 ceph-mon[34166]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.112+0000 7fa2946ae640 1 -- 172.21.15.187:0/91014233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c102640 msgr2=0x7fa28c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.112+0000 7fa2946ae640 1 --2- 172.21.15.187:0/91014233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c102640 0x7fa28c102ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa288009900 tx=0x7fa28802a480 comp rx=0 tx=0).stop 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 -- 172.21.15.187:0/91014233 shutdown_connections 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 --2- 172.21.15.187:0/91014233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c104070 0x7fa28c10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 --2- 172.21.15.187:0/91014233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c1036d0 0x7fa28c103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 --2- 172.21.15.187:0/91014233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c102640 0x7fa28c102ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 -- 172.21.15.187:0/91014233 >> 172.21.15.187:0/91014233 conn(0x7fa28c0fdfb0 msgr2=0x7fa28c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 -- 172.21.15.187:0/91014233 shutdown_connections 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 -- 172.21.15.187:0/91014233 wait complete. 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 Processor -- start 2024-09-21T07:32:12.119 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.113+0000 7fa2946ae640 1 -- start start 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c102640 0x7fa28c198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1036d0 0x7fa28c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 0x7fa28c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c10e280 con 0x7fa28c1036d0 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c10e100 con 0x7fa28c102640 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c10e400 con 0x7fa28c104070 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 0x7fa28c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 0x7fa28c19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:59844/0 (socket says 172.21.15.187:59844) 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 -- 172.21.15.187:0/2875669977 learned_addr learned my addr 172.21.15.187:0/2875669977 (peer_addr_for_me v2:172.21.15.187:0/0) 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa29244a640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c102640 0x7fa28c198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa291c49640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1036d0 0x7fa28c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:12.120 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 -- 172.21.15.187:0/2875669977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c102640 msgr2=0x7fa28c198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c102640 0x7fa28c198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 -- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1036d0 msgr2=0x7fa28c1994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1036d0 0x7fa28c1994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 -- 172.21.15.187:0/2875669977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c19a8b0 con 0x7fa28c104070 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa291c49640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1036d0 0x7fa28c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa292c4b640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 0x7fa28c19a090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa28400eaa0 tx=0x7fa28400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28400cdb0 con 0x7fa28c104070 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa284005020 con 0x7fa28c104070 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.114+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c19aba0 con 0x7fa28c104070 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.115+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840116d0 con 0x7fa28c104070 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.115+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c1a12a0 con 0x7fa28c104070 2024-09-21T07:32:12.121 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.116+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28c109820 con 0x7fa28c104070 2024-09-21T07:32:12.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:11 smithi060 ceph-mon[31244]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:12.123 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.118+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa2840051d0 con 0x7fa28c104070 2024-09-21T07:32:12.123 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.118+0000 7fa2837fe640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa2780b6590 0x7fa2780b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:12.123 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.119+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fa2840e7350 con 0x7fa28c104070 2024-09-21T07:32:12.123 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.119+0000 7fa29244a640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa2780b6590 0x7fa2780b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:12.123 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.119+0000 7fa29244a640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa2780b6590 0x7fa2780b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa288000c00 tx=0x7fa288031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:12.128 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.126+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa284016030 con 0x7fa28c104070 2024-09-21T07:32:12.323 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.322+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}) -- 0x7fa28c063900 con 0x7fa2780b6590 2024-09-21T07:32:12.332 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.330+0000 7fa2837fe640 1 -- 172.21.15.187:0/2875669977 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa28c063900 con 0x7fa2780b6590 2024-09-21T07:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mds.all update... 2024-09-21T07:32:12.335 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa2780b6590 msgr2=0x7fa2780b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:12.335 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa2780b6590 0x7fa2780b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa288000c00 tx=0x7fa288031400 comp rx=0 tx=0).stop 2024-09-21T07:32:12.335 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 msgr2=0x7fa28c19a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:12.335 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 0x7fa28c19a090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa28400eaa0 tx=0x7fa28400ef60 comp rx=0 tx=0).stop 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 shutdown_connections 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fa2780b6590 0x7fa2780b8aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa28c104070 0x7fa28c19a090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa28c1036d0 0x7fa28c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 --2- 172.21.15.187:0/2875669977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa28c102640 0x7fa28c198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 >> 172.21.15.187:0/2875669977 conn(0x7fa28c0fdfb0 msgr2=0x7fa28c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 shutdown_connections 2024-09-21T07:32:12.336 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-21T07:32:12.333+0000 7fa2946ae640 1 -- 172.21.15.187:0/2875669977 wait complete. 2024-09-21T07:32:12.977 DEBUG:teuthology.orchestra.run.smithi060:mds.a> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T07:32:12.980 DEBUG:teuthology.orchestra.run.smithi060:mds.d> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T07:32:13.022 DEBUG:teuthology.orchestra.run.smithi060:mds.g> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T07:32:13.068 DEBUG:teuthology.orchestra.run.smithi060:mds.j> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T07:32:13.110 DEBUG:teuthology.orchestra.run.smithi123:mds.b> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T07:32:13.113 DEBUG:teuthology.orchestra.run.smithi123:mds.e> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T07:32:13.156 DEBUG:teuthology.orchestra.run.smithi123:mds.h> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T07:32:13.199 DEBUG:teuthology.orchestra.run.smithi123:mds.k> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T07:32:13.242 DEBUG:teuthology.orchestra.run.smithi187:mds.c> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T07:32:13.245 DEBUG:teuthology.orchestra.run.smithi187:mds.f> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T07:32:13.287 DEBUG:teuthology.orchestra.run.smithi187:mds.i> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T07:32:13.331 DEBUG:teuthology.orchestra.run.smithi187:mds.l> sudo journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T07:32:13.374 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T07:32:13.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:13.474 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:13.475 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:13 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:13.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:13 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:13.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:13.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:13 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:13.630 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.107+0000 7f869408a640 1 -- 172.21.15.60:0/1622376131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c109df0 msgr2=0x7f868c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.107+0000 7f869408a640 1 --2- 172.21.15.60:0/1622376131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c109df0 0x7f868c110620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8684009ca0 tx=0x7f868402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 -- 172.21.15.60:0/1622376131 shutdown_connections 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 --2- 172.21.15.60:0/1622376131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c109df0 0x7f868c110620 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 --2- 172.21.15.60:0/1622376131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868c1094a0 0x7f868c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 --2- 172.21.15.60:0/1622376131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c103b60 0x7f868c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 -- 172.21.15.60:0/1622376131 >> 172.21.15.60:0/1622376131 conn(0x7f868c07b850 msgr2=0x7f868c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 -- 172.21.15.60:0/1622376131 shutdown_connections 2024-09-21T07:32:14.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 -- 172.21.15.60:0/1622376131 wait complete. 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 Processor -- start 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.108+0000 7f869408a640 1 -- start start 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f869408a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 0x7f868c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f869408a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868c1094a0 0x7f868c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f869408a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c109df0 0x7f868c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f869408a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f868c113ab0 con 0x7f868c103b60 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f869408a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f868c113930 con 0x7f868c1094a0 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f869408a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f868c113c30 con 0x7f868c109df0 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 0x7f868c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 0x7f868c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45758/0 (socket says 172.21.15.60:45758) 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 -- 172.21.15.60:0/4024659005 learned_addr learned my addr 172.21.15.60:0/4024659005 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691625640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868c1094a0 0x7f868c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:14.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8692627640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c109df0 0x7f868c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 -- 172.21.15.60:0/4024659005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c109df0 msgr2=0x7f868c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c109df0 0x7f868c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 -- 172.21.15.60:0/4024659005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868c1094a0 msgr2=0x7f868c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868c1094a0 0x7f868c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 -- 172.21.15.60:0/4024659005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c1a8650 con 0x7f868c103b60 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8692627640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c109df0 0x7f868c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8691e26640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 0x7f868c075710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f868800c920 tx=0x7f868800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688007c70 con 0x7f868c103b60 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.109+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8688007e10 con 0x7f868c103b60 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.110+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c1a8940 con 0x7f868c103b60 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.110+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688018820 con 0x7f868c103b60 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.110+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c1a8e80 con 0x7f868c103b60 2024-09-21T07:32:14.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.111+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868c103f70 con 0x7f868c103b60 2024-09-21T07:32:14.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.112+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f868800f450 con 0x7f868c103b60 2024-09-21T07:32:14.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.113+0000 7f8682ffd640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f86780b6510 0x7f86780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:14.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.113+0000 7f8691625640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f86780b6510 0x7f86780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:14.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.113+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f86880e7240 con 0x7f868c103b60 2024-09-21T07:32:14.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.113+0000 7f8691625640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f86780b6510 0x7f86780b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f868c109190 tx=0x7f867c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:14.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.116+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8688014030 con 0x7f868c103b60 2024-09-21T07:32:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.341+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f868c076a10 con 0x7f868c103b60 2024-09-21T07:32:14.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.341+0000 7f8682ffd640 1 -- 172.21.15.60:0/4024659005 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f86880ae000 con 0x7f868c103b60 2024-09-21T07:32:14.343 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:14.343 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"btime":"2024-09-21T07:24:36:496645+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T07:32:14.344 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 1 2024-09-21T07:32:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f86780b6510 msgr2=0x7f86780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f86780b6510 0x7f86780b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f868c109190 tx=0x7f867c00b410 comp rx=0 tx=0).stop 2024-09-21T07:32:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 msgr2=0x7f868c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 0x7f868c075710 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f868800c920 tx=0x7f868800cde0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 shutdown_connections 2024-09-21T07:32:14.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f86780b6510 0x7f86780b8a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f868c109df0 0x7f868c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f868c1094a0 0x7f868c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 --2- 172.21.15.60:0/4024659005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f868c103b60 0x7f868c075710 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:14.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.343+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 >> 172.21.15.60:0/4024659005 conn(0x7f868c07b850 msgr2=0x7f868c1074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:14.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.344+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 shutdown_connections 2024-09-21T07:32:14.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:14.344+0000 7f869408a640 1 -- 172.21.15.60:0/4024659005 wait complete. 2024-09-21T07:32:14.444 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:14 smithi187 ceph-mon[34367]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:14.444 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:14 smithi187 ceph-mon[34367]: Deploying daemon mds.l on smithi187 2024-09-21T07:32:14.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:14 smithi123 ceph-mon[34166]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:14.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:14 smithi123 ceph-mon[34166]: Deploying daemon mds.l on smithi187 2024-09-21T07:32:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:14 smithi060 ceph-mon[31244]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:14 smithi060 ceph-mon[31244]: Deploying daemon mds.l on smithi187 2024-09-21T07:32:14.769 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:14 smithi187 systemd[1]: Starting Ceph mds.l for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:15.124 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:14 smithi187 podman[62162]: 2024-09-21 07:32:14.744422344 +0000 UTC m=+0.015698111 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:15.125 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:14 smithi187 podman[62162]: 2024-09-21 07:32:14.904746882 +0000 UTC m=+0.176022687 container create ff26f2125b94dc78d790ef2fca8c49dea5c4aecccc9d2dfcc2cce4e892ed9060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:32:15.125 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:15 smithi187 podman[62162]: 2024-09-21 07:32:15.123728118 +0000 UTC m=+0.395003884 container init ff26f2125b94dc78d790ef2fca8c49dea5c4aecccc9d2dfcc2cce4e892ed9060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T07:32:15.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4024659005' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6832/147828917,v1:172.21.15.187:6833/147828917] up:boot 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: fsmap 1 up:standby 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:15.520 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:15 smithi187 podman[62162]: 2024-09-21 07:32:15.126907788 +0000 UTC m=+0.398183544 container start ff26f2125b94dc78d790ef2fca8c49dea5c4aecccc9d2dfcc2cce4e892ed9060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T07:32:15.521 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-mds[62181]: -- 172.21.15.187:0/21151215 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55596e689860 con 0x555972831600 2024-09-21T07:32:15.521 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:15 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l[62177]: starting mds.l at 2024-09-21T07:32:15.521 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:15 smithi187 bash[62162]: ff26f2125b94dc78d790ef2fca8c49dea5c4aecccc9d2dfcc2cce4e892ed9060 2024-09-21T07:32:15.521 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 07:32:15 smithi187 systemd[1]: Started Ceph mds.l for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4024659005' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6832/147828917,v1:172.21.15.187:6833/147828917] up:boot 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: fsmap 1 up:standby 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:15.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4024659005' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6832/147828917,v1:172.21.15.187:6833/147828917] up:boot 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: fsmap 1 up:standby 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:16.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:16 smithi123 ceph-mon[34166]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:16.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:16 smithi123 ceph-mon[34166]: Deploying daemon mds.k on smithi123 2024-09-21T07:32:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:16 smithi060 ceph-mon[31244]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:16.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:16 smithi060 ceph-mon[31244]: Deploying daemon mds.k on smithi123 2024-09-21T07:32:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:16 smithi187 ceph-mon[34367]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:16 smithi187 ceph-mon[34367]: Deploying daemon mds.k on smithi123 2024-09-21T07:32:17.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:17.266 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 systemd[1]: Starting Ceph mds.k for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:17.359 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:17.557 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 podman[62165]: 2024-09-21 07:32:17.168055862 +0000 UTC m=+0.015824857 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:17.557 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 podman[62165]: 2024-09-21 07:32:17.295360392 +0000 UTC m=+0.143129425 container create de7b1a3884ec9a54c276aac3e27e430dde68d5ec5e939261434fee0e6d5b8ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:32:17.558 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 podman[62165]: 2024-09-21 07:32:17.556473999 +0000 UTC m=+0.404242991 container init de7b1a3884ec9a54c276aac3e27e430dde68d5ec5e939261434fee0e6d5b8ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:32:17.849 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 podman[62165]: 2024-09-21 07:32:17.559874938 +0000 UTC m=+0.407643941 container start de7b1a3884ec9a54c276aac3e27e430dde68d5ec5e939261434fee0e6d5b8ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T07:32:17.849 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 ceph-mds[62184]: -- 172.21.15.123:0/1780233641 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a6370d5860 con 0x55a63b27d600 2024-09-21T07:32:17.849 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k[62180]: starting mds.k at 2024-09-21T07:32:17.849 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 bash[62165]: de7b1a3884ec9a54c276aac3e27e430dde68d5ec5e939261434fee0e6d5b8ac5 2024-09-21T07:32:17.849 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 07:32:17 smithi123 systemd[1]: Started Ceph mds.k for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 -- 172.21.15.60:0/1883696038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4107b60 msgr2=0x7f50e4107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 --2- 172.21.15.60:0/1883696038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4107b60 0x7f50e4107f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009900 tx=0x7f50cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:32:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 -- 172.21.15.60:0/1883696038 shutdown_connections 2024-09-21T07:32:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 --2- 172.21.15.60:0/1883696038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e41084b0 0x7f50e410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 --2- 172.21.15.60:0/1883696038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4107b60 0x7f50e4107f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 --2- 172.21.15.60:0/1883696038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e4102220 0x7f50e4102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 -- 172.21.15.60:0/1883696038 >> 172.21.15.60:0/1883696038 conn(0x7f50e4079e30 msgr2=0x7f50e407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 -- 172.21.15.60:0/1883696038 shutdown_connections 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.019+0000 7f50ea406640 1 -- 172.21.15.60:0/1883696038 wait complete. 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 Processor -- start 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 -- start start 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 0x7f50e40fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e4107b60 0x7f50e40ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e41084b0 0x7f50e40ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50e41118f0 con 0x7f50e4102220 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4111770 con 0x7f50e41084b0 2024-09-21T07:32:18.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.020+0000 7f50ea406640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4111a70 con 0x7f50e4107b60 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 0x7f50e40fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 0x7f50e40fee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47962/0 (socket says 172.21.15.60:47962) 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 -- 172.21.15.60:0/3250932575 learned_addr learned my addr 172.21.15.60:0/3250932575 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e89a3640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e41084b0 0x7f50e40ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50dbfff640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e4107b60 0x7f50e40ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 -- 172.21.15.60:0/3250932575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e4107b60 msgr2=0x7f50e40ff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e4107b60 0x7f50e40ff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 -- 172.21.15.60:0/3250932575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e41084b0 msgr2=0x7f50e40ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e41084b0 0x7f50e40ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 -- 172.21.15.60:0/3250932575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e41a87a0 con 0x7f50e4102220 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e3fff640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 0x7f50e40fee60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f50d400d950 tx=0x7f50d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4017070 con 0x7f50e4102220 2024-09-21T07:32:18.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e41a8a90 con 0x7f50e4102220 2024-09-21T07:32:18.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d4009c30 con 0x7f50e4102220 2024-09-21T07:32:18.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d400f620 con 0x7f50e4102220 2024-09-21T07:32:18.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.021+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e41a8ff0 con 0x7f50e4102220 2024-09-21T07:32:18.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.022+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4102630 con 0x7f50e4102220 2024-09-21T07:32:18.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.024+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f50d4005030 con 0x7f50e4102220 2024-09-21T07:32:18.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.025+0000 7f50e1ffb640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f50d00b6510 0x7f50d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:18.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.025+0000 7f50dbfff640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f50d00b6510 0x7f50d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:18.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.025+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f50d40e6980 con 0x7f50e4102220 2024-09-21T07:32:18.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.025+0000 7f50dbfff640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f50d00b6510 0x7f50d00b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009230 tx=0x7f50cc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:18.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.028+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50d4009de0 con 0x7f50e4102220 2024-09-21T07:32:18.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.265+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50e402e640 con 0x7f50e4102220 2024-09-21T07:32:18.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.265+0000 7f50e1ffb640 1 -- 172.21.15.60:0/3250932575 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f50d40b1a90 con 0x7f50e4102220 2024-09-21T07:32:18.267 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:18.267 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"btime":"2024-09-21T07:32:15:165556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:32:18.267 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 2 2024-09-21T07:32:18.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f50d00b6510 msgr2=0x7f50d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f50d00b6510 0x7f50d00b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009230 tx=0x7f50cc031400 comp rx=0 tx=0).stop 2024-09-21T07:32:18.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 msgr2=0x7f50e40fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 0x7f50e40fee60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f50d400d950 tx=0x7f50d400de10 comp rx=0 tx=0).stop 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 shutdown_connections 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f50d00b6510 0x7f50d00b8a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e41084b0 0x7f50e40ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50e4107b60 0x7f50e40ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 --2- 172.21.15.60:0/3250932575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4102220 0x7f50e40fee60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 >> 172.21.15.60:0/3250932575 conn(0x7f50e4079e30 msgr2=0x7f50e4105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 shutdown_connections 2024-09-21T07:32:18.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:18.268+0000 7f50ea406640 1 -- 172.21.15.60:0/3250932575 wait complete. 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:18.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:18 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3250932575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:18.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:18.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:18.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:18.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:18.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:18 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3250932575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:18.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:18 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3250932575' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:19 smithi060 ceph-mon[31244]: Deploying daemon mds.j on smithi060 2024-09-21T07:32:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:19 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6832/192831616,v1:172.21.15.123:6833/192831616] up:boot 2024-09-21T07:32:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:19 smithi060 ceph-mon[31244]: fsmap 2 up:standby 2024-09-21T07:32:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:32:19.718 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:19 smithi123 ceph-mon[34166]: Deploying daemon mds.j on smithi060 2024-09-21T07:32:19.718 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:19 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6832/192831616,v1:172.21.15.123:6833/192831616] up:boot 2024-09-21T07:32:19.718 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:19 smithi123 ceph-mon[34166]: fsmap 2 up:standby 2024-09-21T07:32:19.718 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:32:19.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:19 smithi187 ceph-mon[34367]: Deploying daemon mds.j on smithi060 2024-09-21T07:32:19.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:19 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6832/192831616,v1:172.21.15.123:6833/192831616] up:boot 2024-09-21T07:32:19.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:19 smithi187 ceph-mon[34367]: fsmap 2 up:standby 2024-09-21T07:32:19.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:32:20.356 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 systemd[1]: Starting Ceph mds.j for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:20 smithi060 ceph-mon[31244]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:20.622 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 podman[71801]: 2024-09-21 07:32:20.447311674 +0000 UTC m=+0.111115743 container create f79407b53b8a2f7e8acb74337d900b2a998949dd94b0c58f90c32c99acd7561c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:32:20.622 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 podman[71801]: 2024-09-21 07:32:20.352499169 +0000 UTC m=+0.016303206 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:20.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:20 smithi187 ceph-mon[34367]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:20.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:20 smithi123 ceph-mon[34166]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:20.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:21.011 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 podman[71801]: 2024-09-21 07:32:20.716682138 +0000 UTC m=+0.380486175 container init f79407b53b8a2f7e8acb74337d900b2a998949dd94b0c58f90c32c99acd7561c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T07:32:21.011 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 podman[71801]: 2024-09-21 07:32:20.719714371 +0000 UTC m=+0.383518407 container start f79407b53b8a2f7e8acb74337d900b2a998949dd94b0c58f90c32c99acd7561c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T07:32:21.011 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 ceph-mds[71820]: -- 172.21.15.60:0/606287618 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f0ae15860 con 0x563f0efbda80 2024-09-21T07:32:21.012 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j[71816]: starting mds.j at 2024-09-21T07:32:21.012 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 bash[71801]: f79407b53b8a2f7e8acb74337d900b2a998949dd94b0c58f90c32c99acd7561c 2024-09-21T07:32:21.012 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 07:32:20 smithi060 systemd[1]: Started Ceph mds.j for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:22.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: Deploying daemon mds.d on smithi060 2024-09-21T07:32:22.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.60:6834/2104077895,v1:172.21.15.60:6835/2104077895] up:boot 2024-09-21T07:32:22.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: fsmap 3 up:standby 2024-09-21T07:32:22.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:32:22.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: Deploying daemon mds.d on smithi060 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.60:6834/2104077895,v1:172.21.15.60:6835/2104077895] up:boot 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: fsmap 3 up:standby 2024-09-21T07:32:22.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:32:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: Deploying daemon mds.d on smithi060 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.60:6834/2104077895,v1:172.21.15.60:6835/2104077895] up:boot 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: fsmap 3 up:standby 2024-09-21T07:32:22.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:32:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 -- 172.21.15.60:0/1157287982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c04102a60 msgr2=0x7f0c04102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/1157287982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c04102a60 0x7f0c04102e70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009900 tx=0x7f0bf802a410 comp rx=0 tx=0).stop 2024-09-21T07:32:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 -- 172.21.15.60:0/1157287982 shutdown_connections 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/1157287982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c04108cf0 0x7f0c0410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/1157287982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c041083a0 0x7f0c041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/1157287982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c04102a60 0x7f0c04102e70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 -- 172.21.15.60:0/1157287982 >> 172.21.15.60:0/1157287982 conn(0x7f0c04079730 msgr2=0x7f0c04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 -- 172.21.15.60:0/1157287982 shutdown_connections 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.875+0000 7f0c0aa85640 1 -- 172.21.15.60:0/1157287982 wait complete. 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.876+0000 7f0c0aa85640 1 Processor -- start 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.876+0000 7f0c0aa85640 1 -- start start 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c0aa85640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c04102a60 0x7f0c0419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c0aa85640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 0x7f0c0419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c0aa85640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c04108cf0 0x7f0c0419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c0aa85640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04112a40 con 0x7f0c041083a0 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c0aa85640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c041128c0 con 0x7f0c04102a60 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c0aa85640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04112bc0 con 0x7f0c04108cf0 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 0x7f0c0419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 0x7f0c0419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48008/0 (socket says 172.21.15.60:48008) 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 -- 172.21.15.60:0/2576746887 learned_addr learned my addr 172.21.15.60:0/2576746887 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c08821640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c04102a60 0x7f0c0419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c09022640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c04108cf0 0x7f0c0419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 -- 172.21.15.60:0/2576746887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c04108cf0 msgr2=0x7f0c0419be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c04108cf0 0x7f0c0419be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 -- 172.21.15.60:0/2576746887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c04102a60 msgr2=0x7f0c0419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c04102a60 0x7f0c0419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 -- 172.21.15.60:0/2576746887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c041a6690 con 0x7f0c041083a0 2024-09-21T07:32:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c03fff640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 0x7f0c0419b910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b450 tx=0x7f0bf000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.877+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0015020 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.878+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bf0011d40 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.878+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000f340 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.878+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c041a6980 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.878+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c041a6f40 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.879+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c04102ef0 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.881+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0bf0018020 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.882+0000 7f0c01ffb640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0bf40b6510 0x7f0bf40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.882+0000 7f0c08821640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0bf40b6510 0x7f0bf40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.882+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f0bf00e6cd0 con 0x7f0c041083a0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.882+0000 7f0c08821640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0bf40b6510 0x7f0bf40b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8000c00 tx=0x7f0bf8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:22.889+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0bf001f020 con 0x7f0c041083a0 2024-09-21T07:32:23.114 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 podman[72166]: 2024-09-21 07:32:22.998328439 +0000 UTC m=+0.016646792 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:23.114 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 podman[72166]: 2024-09-21 07:32:23.113387111 +0000 UTC m=+0.131705454 container create cbeeac9bc47cc96296b8fcbe9b3ee3a20901722aa8d2019fdae64f5744af7b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T07:32:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.122+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c0406b290 con 0x7f0c041083a0 2024-09-21T07:32:23.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.123+0000 7f0c01ffb640 1 -- 172.21.15.60:0/2576746887 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f0c0406b290 con 0x7f0c041083a0 2024-09-21T07:32:23.124 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:23.124 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":4,"btime":"2024-09-21T07:32:21:355577+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:32:23.125 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 4 2024-09-21T07:32:23.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0bf40b6510 msgr2=0x7f0bf40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0bf40b6510 0x7f0bf40b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8000c00 tx=0x7f0bf8031400 comp rx=0 tx=0).stop 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 msgr2=0x7f0c0419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 0x7f0c0419b910 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000b450 tx=0x7f0bf000b910 comp rx=0 tx=0).stop 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 shutdown_connections 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0bf40b6510 0x7f0bf40b8a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c04108cf0 0x7f0c0419be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c041083a0 0x7f0c0419b910 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 --2- 172.21.15.60:0/2576746887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c04102a60 0x7f0c0419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:23.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 >> 172.21.15.60:0/2576746887 conn(0x7f0c04079730 msgr2=0x7f0c041014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:23.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 shutdown_connections 2024-09-21T07:32:23.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:23.125+0000 7f0c0aa85640 1 -- 172.21.15.60:0/2576746887 wait complete. 2024-09-21T07:32:23.850 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 podman[72166]: 2024-09-21 07:32:23.542665656 +0000 UTC m=+0.560984006 container init cbeeac9bc47cc96296b8fcbe9b3ee3a20901722aa8d2019fdae64f5744af7b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T07:32:23.850 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 podman[72166]: 2024-09-21 07:32:23.545671892 +0000 UTC m=+0.563990236 container start cbeeac9bc47cc96296b8fcbe9b3ee3a20901722aa8d2019fdae64f5744af7b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:32:23.851 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mds[72198]: -- 172.21.15.60:0/2680778419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630a4f89860 con 0x5630a9131180 2024-09-21T07:32:23.851 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d[72194]: starting mds.d at 2024-09-21T07:32:23.851 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 bash[72166]: cbeeac9bc47cc96296b8fcbe9b3ee3a20901722aa8d2019fdae64f5744af7b76 2024-09-21T07:32:23.851 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 07:32:23 smithi060 systemd[1]: Started Ceph mds.d for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:24.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:24.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2576746887' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2576746887' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:24.192 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2576746887' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:24.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:24.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:24.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:25.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:24 smithi060 ceph-mon[31244]: Deploying daemon mds.e on smithi123 2024-09-21T07:32:25.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:24 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.60:6836/1000584713,v1:172.21.15.60:6837/1000584713] up:boot 2024-09-21T07:32:25.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:24 smithi060 ceph-mon[31244]: fsmap 4 up:standby 2024-09-21T07:32:25.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:32:25.190 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:24 smithi123 ceph-mon[34166]: Deploying daemon mds.e on smithi123 2024-09-21T07:32:25.191 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:24 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.60:6836/1000584713,v1:172.21.15.60:6837/1000584713] up:boot 2024-09-21T07:32:25.191 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:24 smithi123 ceph-mon[34166]: fsmap 4 up:standby 2024-09-21T07:32:25.191 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:32:25.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:24 smithi187 ceph-mon[34367]: Deploying daemon mds.e on smithi123 2024-09-21T07:32:25.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:24 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.60:6836/1000584713,v1:172.21.15.60:6837/1000584713] up:boot 2024-09-21T07:32:25.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:24 smithi187 ceph-mon[34367]: fsmap 4 up:standby 2024-09-21T07:32:25.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:32:25.599 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 systemd[1]: Starting Ceph mds.e for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:25.895 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:25 smithi123 ceph-mon[34166]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:25.895 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 podman[62444]: 2024-09-21 07:32:25.531638187 +0000 UTC m=+0.015813366 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:25.896 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 podman[62444]: 2024-09-21 07:32:25.631390449 +0000 UTC m=+0.115565635 container create d2a69f14520ef63929d0715cb87df21859ac9f15d5a21f979275c7a8878ae698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T07:32:25.896 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 podman[62444]: 2024-09-21 07:32:25.858693609 +0000 UTC m=+0.342868788 container init d2a69f14520ef63929d0715cb87df21859ac9f15d5a21f979275c7a8878ae698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-21T07:32:25.896 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 podman[62444]: 2024-09-21 07:32:25.861659582 +0000 UTC m=+0.345834762 container start d2a69f14520ef63929d0715cb87df21859ac9f15d5a21f979275c7a8878ae698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T07:32:25.896 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 ceph-mds[62463]: -- 172.21.15.123:0/2494525283 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3de74d860 con 0x55e3e28f5180 2024-09-21T07:32:26.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:26.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:25 smithi060 ceph-mon[31244]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:25 smithi187 ceph-mon[34367]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:26.348 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e[62459]: starting mds.e at 2024-09-21T07:32:26.349 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 bash[62444]: d2a69f14520ef63929d0715cb87df21859ac9f15d5a21f979275c7a8878ae698 2024-09-21T07:32:26.349 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 07:32:25 smithi123 systemd[1]: Started Ceph mds.e for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:26.366 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 -- 172.21.15.60:0/8073078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c108cf0 msgr2=0x7f6a4c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 --2- 172.21.15.60:0/8073078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c108cf0 0x7f6a4c10f520 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009ca0 tx=0x7f6a4402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 -- 172.21.15.60:0/8073078 shutdown_connections 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 --2- 172.21.15.60:0/8073078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c108cf0 0x7f6a4c10f520 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 --2- 172.21.15.60:0/8073078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a4c1083a0 0x7f6a4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 --2- 172.21.15.60:0/8073078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a4c102a60 0x7f6a4c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 -- 172.21.15.60:0/8073078 >> 172.21.15.60:0/8073078 conn(0x7f6a4c079730 msgr2=0x7f6a4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 -- 172.21.15.60:0/8073078 shutdown_connections 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.808+0000 7f6a535a9640 1 -- 172.21.15.60:0/8073078 wait complete. 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 Processor -- start 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 -- start start 2024-09-21T07:32:26.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 0x7f6a4c1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a4c1083a0 0x7f6a4c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a4c108cf0 0x7f6a4c199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c112960 con 0x7f6a4c102a60 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c1127e0 con 0x7f6a4c1083a0 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a535a9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4c112ae0 con 0x7f6a4c108cf0 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a51345640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 0x7f6a4c1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a51345640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 0x7f6a4c1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51836/0 (socket says 172.21.15.60:51836) 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a51345640 1 -- 172.21.15.60:0/2559983026 learned_addr learned my addr 172.21.15.60:0/2559983026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.809+0000 7f6a51b46640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a4c108cf0 0x7f6a4c199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a50b44640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a4c1083a0 0x7f6a4c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:26.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a51345640 1 -- 172.21.15.60:0/2559983026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a4c108cf0 msgr2=0x7f6a4c199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a51345640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a4c108cf0 0x7f6a4c199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a51345640 1 -- 172.21.15.60:0/2559983026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a4c1083a0 msgr2=0x7f6a4c1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a51345640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a4c1083a0 0x7f6a4c1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a51345640 1 -- 172.21.15.60:0/2559983026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4c1a8720 con 0x7f6a4c102a60 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a51345640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 0x7f6a4c1990a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c920 tx=0x7f6a4800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48007c70 con 0x7f6a4c102a60 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a48007e10 con 0x7f6a4c102a60 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4c1a89b0 con 0x7f6a4c102a60 2024-09-21T07:32:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48018820 con 0x7f6a4c102a60 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.810+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4c1a8ef0 con 0x7f6a4c102a60 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.812+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4c102e70 con 0x7f6a4c102a60 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.813+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6a4800f450 con 0x7f6a4c102a60 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.814+0000 7f6a3e7fc640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a380b6510 0x7f6a380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.815+0000 7f6a50b44640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a380b6510 0x7f6a380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.815+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f6a480e7350 con 0x7f6a4c102a60 2024-09-21T07:32:26.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.815+0000 7f6a50b44640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a380b6510 0x7f6a380b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005fd0 tx=0x7f6a40005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:26.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:26.818+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a48014030 con 0x7f6a4c102a60 2024-09-21T07:32:27.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.045+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a4c10a550 con 0x7f6a4c102a60 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: Deploying daemon mds.f on smithi187 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6834/1302227504,v1:172.21.15.123:6835/1302227504] up:boot 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: fsmap 5 up:standby 2024-09-21T07:32:27.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:32:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.046+0000 7f6a3e7fc640 1 -- 172.21.15.60:0/2559983026 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7f6a480adfe0 con 0x7f6a4c102a60 2024-09-21T07:32:27.049 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:27.049 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":6,"btime":"2024-09-21T07:32:26:856950+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T07:32:27.049 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 6 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.049+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a380b6510 msgr2=0x7f6a380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.049+0000 7f6a535a9640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a380b6510 0x7f6a380b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005fd0 tx=0x7f6a40005850 comp rx=0 tx=0).stop 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.049+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 msgr2=0x7f6a4c1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.049+0000 7f6a535a9640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 0x7f6a4c1990a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c920 tx=0x7f6a4800cde0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 shutdown_connections 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a380b6510 0x7f6a380b8a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a4c108cf0 0x7f6a4c199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a4c1083a0 0x7f6a4c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 --2- 172.21.15.60:0/2559983026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4c102a60 0x7f6a4c1990a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 >> 172.21.15.60:0/2559983026 conn(0x7f6a4c079730 msgr2=0x7f6a4c104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 shutdown_connections 2024-09-21T07:32:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:27.050+0000 7f6a535a9640 1 -- 172.21.15.60:0/2559983026 wait complete. 2024-09-21T07:32:27.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: Deploying daemon mds.f on smithi187 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6834/1302227504,v1:172.21.15.123:6835/1302227504] up:boot 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: fsmap 5 up:standby 2024-09-21T07:32:27.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: Deploying daemon mds.f on smithi187 2024-09-21T07:32:27.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6834/1302227504,v1:172.21.15.123:6835/1302227504] up:boot 2024-09-21T07:32:27.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: fsmap 5 up:standby 2024-09-21T07:32:27.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:32:28.012 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:27 smithi187 systemd[1]: Starting Ceph mds.f for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:28 smithi187 ceph-mon[34367]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:28 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2559983026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:28.270 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 podman[62433]: 2024-09-21 07:32:27.993050979 +0000 UTC m=+0.016000994 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:28.270 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 podman[62433]: 2024-09-21 07:32:28.106381844 +0000 UTC m=+0.129331846 container create ee2914c119e4d06203be655014e73ae389d709bb8ab736d77e79a529dd489be0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T07:32:28.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:28 smithi060 ceph-mon[31244]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:28.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:28 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2559983026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:28 smithi123 ceph-mon[34166]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:28.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:28 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2559983026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:28.769 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 podman[62433]: 2024-09-21 07:32:28.35903261 +0000 UTC m=+0.381982613 container init ee2914c119e4d06203be655014e73ae389d709bb8ab736d77e79a529dd489be0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T07:32:28.770 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 podman[62433]: 2024-09-21 07:32:28.361950254 +0000 UTC m=+0.384900271 container start ee2914c119e4d06203be655014e73ae389d709bb8ab736d77e79a529dd489be0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T07:32:28.770 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 ceph-mds[62452]: -- 172.21.15.187:0/859190987 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b6eb141860 con 0x55b6ef2e9a80 2024-09-21T07:32:28.770 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f[62448]: starting mds.f at 2024-09-21T07:32:28.770 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 bash[62433]: ee2914c119e4d06203be655014e73ae389d709bb8ab736d77e79a529dd489be0 2024-09-21T07:32:28.770 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 07:32:28 smithi187 systemd[1]: Started Ceph mds.f for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:29.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:29.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: Deploying daemon mds.c on smithi187 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6834/1725714173,v1:172.21.15.187:6835/1725714173] up:boot 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: fsmap 6 up:standby 2024-09-21T07:32:29.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:29 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:32:29.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:29.797 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:29.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:29.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: Deploying daemon mds.c on smithi187 2024-09-21T07:32:29.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:29.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6834/1725714173,v1:172.21.15.187:6835/1725714173] up:boot 2024-09-21T07:32:29.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: fsmap 6 up:standby 2024-09-21T07:32:29.798 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:29 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: Deploying daemon mds.c on smithi187 2024-09-21T07:32:29.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6834/1725714173,v1:172.21.15.187:6835/1725714173] up:boot 2024-09-21T07:32:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: fsmap 6 up:standby 2024-09-21T07:32:29.850 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:29 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:32:30.042 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:30.520 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 systemd[1]: Starting Ceph mds.c for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:30.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 -- 172.21.15.60:0/1814851381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb41094a0 msgr2=0x7fceb41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/1814851381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb41094a0 0x7fceb41098b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009900 tx=0x7fcea802a410 comp rx=0 tx=0).stop 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 -- 172.21.15.60:0/1814851381 shutdown_connections 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/1814851381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceb4109df0 0x7fceb4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/1814851381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb41094a0 0x7fceb41098b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/1814851381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb4103b60 0x7fceb4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.532+0000 7fcebc2ca640 1 -- 172.21.15.60:0/1814851381 >> 172.21.15.60:0/1814851381 conn(0x7fceb407b850 msgr2=0x7fceb407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.533+0000 7fcebc2ca640 1 -- 172.21.15.60:0/1814851381 shutdown_connections 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.533+0000 7fcebc2ca640 1 -- 172.21.15.60:0/1814851381 wait complete. 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.533+0000 7fcebc2ca640 1 Processor -- start 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.533+0000 7fcebc2ca640 1 -- start start 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.533+0000 7fcebc2ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 0x7fceb419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.533+0000 7fcebc2ca640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb41094a0 0x7fceb419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fcebc2ca640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceb4109df0 0x7fceb419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fcebc2ca640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fceb4113b00 con 0x7fceb4103b60 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fcebc2ca640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fceb4113980 con 0x7fceb4109df0 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fcebc2ca640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fceb4113c80 con 0x7fceb41094a0 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 0x7fceb419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 0x7fceb419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51848/0 (socket says 172.21.15.60:51848) 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 -- 172.21.15.60:0/2025021411 learned_addr learned my addr 172.21.15.60:0/2025021411 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba867640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceb4109df0 0x7fceb419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceb9865640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb41094a0 0x7fceb419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 -- 172.21.15.60:0/2025021411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb41094a0 msgr2=0x7fceb419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb41094a0 0x7fceb419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 -- 172.21.15.60:0/2025021411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceb4109df0 msgr2=0x7fceb419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceb4109df0 0x7fceb419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 -- 172.21.15.60:0/2025021411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb41a0500 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceb9865640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb41094a0 0x7fceb419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceba066640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 0x7fceb419a590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fceac00d770 tx=0x7fceac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac017070 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceac0054d0 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb41a07f0 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac004c30 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.534+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb41a6f50 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.535+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb4104de0 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.537+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fceac004dd0 con 0x7fceb4103b60 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.538+0000 7fceb37fe640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce9c0b6590 0x7fce9c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:30.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.538+0000 7fceb9865640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce9c0b6590 0x7fce9c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:30.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.538+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fceac0e6d00 con 0x7fceb4103b60 2024-09-21T07:32:30.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.538+0000 7fceb9865640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce9c0b6590 0x7fce9c0b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcea802aa00 tx=0x7fcea8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:30.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.541+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fceac0ada10 con 0x7fceb4103b60 2024-09-21T07:32:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.767+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fceb4103f70 con 0x7fceb4103b60 2024-09-21T07:32:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.768+0000 7fceb37fe640 1 -- 172.21.15.60:0/2025021411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7fceb4103f70 con 0x7fceb4103b60 2024-09-21T07:32:30.770 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:30.770 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-21T07:32:29:010999+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T07:32:30.770 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-21T07:32:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.770+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce9c0b6590 msgr2=0x7fce9c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.770+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce9c0b6590 0x7fce9c0b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcea802aa00 tx=0x7fcea8031400 comp rx=0 tx=0).stop 2024-09-21T07:32:30.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.770+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 msgr2=0x7fceb419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.770+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 0x7fceb419a590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fceac00d770 tx=0x7fceac00dc30 comp rx=0 tx=0).stop 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 shutdown_connections 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce9c0b6590 0x7fce9c0b8aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceb4109df0 0x7fceb419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceb41094a0 0x7fceb419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 --2- 172.21.15.60:0/2025021411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb4103b60 0x7fceb419a590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 >> 172.21.15.60:0/2025021411 conn(0x7fceb407b850 msgr2=0x7fceb4105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 shutdown_connections 2024-09-21T07:32:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:30.771+0000 7fcebc2ca640 1 -- 172.21.15.60:0/2025021411 wait complete. 2024-09-21T07:32:30.850 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 podman[62703]: 2024-09-21 07:32:30.498962159 +0000 UTC m=+0.015711846 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:30.850 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 podman[62703]: 2024-09-21 07:32:30.70133456 +0000 UTC m=+0.218084244 container create b6afb6761bf44c50bcba18baa00fc053c73aff43631f259ad690f7fadcce7851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T07:32:31.269 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 podman[62703]: 2024-09-21 07:32:30.960635146 +0000 UTC m=+0.477384840 container init b6afb6761bf44c50bcba18baa00fc053c73aff43631f259ad690f7fadcce7851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T07:32:31.270 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 podman[62703]: 2024-09-21 07:32:30.963297569 +0000 UTC m=+0.480047254 container start b6afb6761bf44c50bcba18baa00fc053c73aff43631f259ad690f7fadcce7851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T07:32:31.270 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 ceph-mds[62722]: -- 172.21.15.187:0/2900419077 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562712f89860 con 0x562717131180 2024-09-21T07:32:31.270 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c[62718]: starting mds.c at 2024-09-21T07:32:31.270 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:31 smithi187 bash[62703]: b6afb6761bf44c50bcba18baa00fc053c73aff43631f259ad690f7fadcce7851 2024-09-21T07:32:31.270 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 07:32:31 smithi187 systemd[1]: Started Ceph mds.c for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2025021411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:31.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:31.831 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:31 smithi123 ceph-mon[34166]: Deploying daemon mds.h on smithi123 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2025021411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:31.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:31 smithi060 ceph-mon[31244]: Deploying daemon mds.h on smithi123 2024-09-21T07:32:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2025021411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:32.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:31 smithi187 ceph-mon[34367]: Deploying daemon mds.h on smithi123 2024-09-21T07:32:32.829 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:32 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6836/4006232422,v1:172.21.15.187:6837/4006232422] up:boot 2024-09-21T07:32:32.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:32 smithi123 ceph-mon[34166]: fsmap 7 up:standby 2024-09-21T07:32:32.830 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:32:33.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:32 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6836/4006232422,v1:172.21.15.187:6837/4006232422] up:boot 2024-09-21T07:32:33.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:32 smithi187 ceph-mon[34367]: fsmap 7 up:standby 2024-09-21T07:32:33.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:32:33.098 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 systemd[1]: Starting Ceph mds.h for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:33.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:32 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6836/4006232422,v1:172.21.15.187:6837/4006232422] up:boot 2024-09-21T07:32:33.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:32 smithi060 ceph-mon[31244]: fsmap 7 up:standby 2024-09-21T07:32:33.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:32:33.491 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 podman[62713]: 2024-09-21 07:32:33.210053834 +0000 UTC m=+0.106682728 container create aefdfa999a61c5310cd9b9639bbe24232c935a253416527898ce1573db44e6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T07:32:33.491 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 podman[62713]: 2024-09-21 07:32:33.118892158 +0000 UTC m=+0.015521065 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:33.492 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 podman[62713]: 2024-09-21 07:32:33.45442886 +0000 UTC m=+0.351057754 container init aefdfa999a61c5310cd9b9639bbe24232c935a253416527898ce1573db44e6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T07:32:33.492 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 podman[62713]: 2024-09-21 07:32:33.457278346 +0000 UTC m=+0.353907241 container start aefdfa999a61c5310cd9b9639bbe24232c935a253416527898ce1573db44e6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T07:32:33.492 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mds[62733]: -- 172.21.15.123:0/1454418731 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56014958d860 con 0x56014d735180 2024-09-21T07:32:33.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:33.768 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:33.848 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h[62729]: starting mds.h at 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 bash[62713]: aefdfa999a61c5310cd9b9639bbe24232c935a253416527898ce1573db44e6a2 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 07:32:33 smithi123 systemd[1]: Started Ceph mds.h for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:33.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:33.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:33.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:33.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:33.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:33.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:33.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:33.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:34.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:34.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:34.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:34.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:34.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:34.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:34.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 -- 172.21.15.60:0/2409278421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578107be0 msgr2=0x7fd578107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 --2- 172.21.15.60:0/2409278421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578107be0 0x7fd578107ff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009900 tx=0x7fd56c02a410 comp rx=0 tx=0).stop 2024-09-21T07:32:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 -- 172.21.15.60:0/2409278421 shutdown_connections 2024-09-21T07:32:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 --2- 172.21.15.60:0/2409278421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd578108530 0x7fd57810ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 --2- 172.21.15.60:0/2409278421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578107be0 0x7fd578107ff0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 --2- 172.21.15.60:0/2409278421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 0x7fd5781026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.233+0000 7fd57c92c640 1 -- 172.21.15.60:0/2409278421 >> 172.21.15.60:0/2409278421 conn(0x7fd578079ec0 msgr2=0x7fd57807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.234+0000 7fd57c92c640 1 -- 172.21.15.60:0/2409278421 shutdown_connections 2024-09-21T07:32:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.234+0000 7fd57c92c640 1 -- 172.21.15.60:0/2409278421 wait complete. 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.234+0000 7fd57c92c640 1 Processor -- start 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.234+0000 7fd57c92c640 1 -- start start 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57c92c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 0x7fd5780feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57c92c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd578107be0 0x7fd5780ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57c92c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 0x7fd5780ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57c92c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd578111970 con 0x7fd578108530 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57c92c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd5781117f0 con 0x7fd5781022a0 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57c92c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd578111af0 con 0x7fd578107be0 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 0x7fd5780ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 0x7fd5780feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 0x7fd5780ff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51870/0 (socket says 172.21.15.60:51870) 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 -- 172.21.15.60:0/623693558 learned_addr learned my addr 172.21.15.60:0/623693558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd575d9b640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd578107be0 0x7fd5780ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 -- 172.21.15.60:0/623693558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd578107be0 msgr2=0x7fd5780ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd578107be0 0x7fd5780ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 -- 172.21.15.60:0/623693558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 msgr2=0x7fd5780feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 0x7fd5780feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 -- 172.21.15.60:0/623693558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5781a8860 con 0x7fd578108530 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd57659c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 0x7fd5780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.235+0000 7fd576d9d640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 0x7fd5780ff970 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd570009fd0 tx=0x7fd57000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.236+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570017070 con 0x7fd578108530 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.236+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd570003e20 con 0x7fd578108530 2024-09-21T07:32:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.236+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570010460 con 0x7fd578108530 2024-09-21T07:32:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.236+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5781a8b50 con 0x7fd578108530 2024-09-21T07:32:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.236+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5781a9010 con 0x7fd578108530 2024-09-21T07:32:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.237+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5781026b0 con 0x7fd578108530 2024-09-21T07:32:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.239+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd570003970 con 0x7fd578108530 2024-09-21T07:32:34.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.239+0000 7fd5677fe640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd5600b6510 0x7fd5600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:34.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.239+0000 7fd57659c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd5600b6510 0x7fd5600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:34.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.240+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fd5700e6b40 con 0x7fd578108530 2024-09-21T07:32:34.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.240+0000 7fd57659c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd5600b6510 0x7fd5600b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd578100940 tx=0x7fd568010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:34.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.242+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5700b1c50 con 0x7fd578108530 2024-09-21T07:32:34.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.468+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd57802e640 con 0x7fd578108530 2024-09-21T07:32:34.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.469+0000 7fd5677fe640 1 -- 172.21.15.60:0/623693558 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7fd5700b6b90 con 0x7fd578108530 2024-09-21T07:32:34.471 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:34.471 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"btime":"2024-09-21T07:32:33:657441+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T07:32:34.471 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2024-09-21T07:32:34.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.471+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd5600b6510 msgr2=0x7fd5600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.471+0000 7fd57c92c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd5600b6510 0x7fd5600b8a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd578100940 tx=0x7fd568010040 comp rx=0 tx=0).stop 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 msgr2=0x7fd5780ff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 0x7fd5780ff970 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd570009fd0 tx=0x7fd57000b260 comp rx=0 tx=0).stop 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 shutdown_connections 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd5600b6510 0x7fd5600b8a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd578108530 0x7fd5780ff970 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd578107be0 0x7fd5780ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 --2- 172.21.15.60:0/623693558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5781022a0 0x7fd5780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 >> 172.21.15.60:0/623693558 conn(0x7fd578079ec0 msgr2=0x7fd578103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 shutdown_connections 2024-09-21T07:32:34.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:34.472+0000 7fd57c92c640 1 -- 172.21.15.60:0/623693558 wait complete. 2024-09-21T07:32:34.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:34 smithi060 ceph-mon[31244]: Deploying daemon mds.i on smithi187 2024-09-21T07:32:34.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:34 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] up:boot 2024-09-21T07:32:34.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:34 smithi060 ceph-mon[31244]: fsmap 8 up:standby 2024-09-21T07:32:34.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:34 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:32:34.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:34 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/623693558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:35.001 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:34 smithi187 ceph-mon[34367]: Deploying daemon mds.i on smithi187 2024-09-21T07:32:35.001 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:34 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] up:boot 2024-09-21T07:32:35.001 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:34 smithi187 ceph-mon[34367]: fsmap 8 up:standby 2024-09-21T07:32:35.001 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:34 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:32:35.001 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:34 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/623693558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:35.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:34 smithi123 ceph-mon[34166]: Deploying daemon mds.i on smithi187 2024-09-21T07:32:35.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:34 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] up:boot 2024-09-21T07:32:35.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:34 smithi123 ceph-mon[34166]: fsmap 8 up:standby 2024-09-21T07:32:35.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:34 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:32:35.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:34 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/623693558' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:35.671 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 systemd[1]: Starting Ceph mds.i for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:35.948 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:35 smithi187 ceph-mon[34367]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:35.948 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 podman[62975]: 2024-09-21 07:32:35.600408616 +0000 UTC m=+0.015723867 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:35.948 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 podman[62975]: 2024-09-21 07:32:35.70282203 +0000 UTC m=+0.118137273 container create f850835d2b81a22a0572feaa1426fbdca2d0ecda5680410e518d8ebc6320649d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:32:35.948 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 podman[62975]: 2024-09-21 07:32:35.947037018 +0000 UTC m=+0.362352262 container init f850835d2b81a22a0572feaa1426fbdca2d0ecda5680410e518d8ebc6320649d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T07:32:36.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:35 smithi123 ceph-mon[34166]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:36.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:35 smithi060 ceph-mon[31244]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:36.271 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 podman[62975]: 2024-09-21 07:32:35.950110057 +0000 UTC m=+0.365425298 container start f850835d2b81a22a0572feaa1426fbdca2d0ecda5680410e518d8ebc6320649d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T07:32:36.271 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 ceph-mds[62994]: -- 172.21.15.187:0/3671793299 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4098eb860 con 0x55a40da93180 2024-09-21T07:32:36.272 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i[62990]: starting mds.i at 2024-09-21T07:32:36.272 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:36 smithi187 bash[62975]: f850835d2b81a22a0572feaa1426fbdca2d0ecda5680410e518d8ebc6320649d 2024-09-21T07:32:36.272 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 07:32:36 smithi187 systemd[1]: Started Ceph mds.i for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:37.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:37.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: Deploying daemon mds.g on smithi060 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] up:boot 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: fsmap 9 up:standby 2024-09-21T07:32:37.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:37 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:32:37.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: Deploying daemon mds.g on smithi060 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] up:boot 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: fsmap 9 up:standby 2024-09-21T07:32:37.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:37 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: Deploying daemon mds.g on smithi060 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] up:boot 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: fsmap 9 up:standby 2024-09-21T07:32:37.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:37 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:32:37.619 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 -- 172.21.15.60:0/1035089833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc10de60 msgr2=0x7f7bcc110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1035089833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc10de60 0x7f7bcc110330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009ca0 tx=0x7f7bc402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 -- 172.21.15.60:0/1035089833 shutdown_connections 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1035089833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc10de60 0x7f7bcc110330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1035089833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bcc105380 0x7f7bcc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1035089833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc104a30 0x7f7bcc104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 -- 172.21.15.60:0/1035089833 >> 172.21.15.60:0/1035089833 conn(0x7f7bcc079760 msgr2=0x7f7bcc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 -- 172.21.15.60:0/1035089833 shutdown_connections 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.250+0000 7f7bd430a640 1 -- 172.21.15.60:0/1035089833 wait complete. 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 Processor -- start 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 -- start start 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 0x7f7bcc102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bcc105380 0x7f7bcc102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc10de60 0x7f7bcc1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc113ac0 con 0x7f7bcc104a30 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc113940 con 0x7f7bcc10de60 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd430a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc113c40 con 0x7f7bcc105380 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.251+0000 7f7bd20a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 0x7f7bcc102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 0x7f7bcc102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40492/0 (socket says 172.21.15.60:40492) 2024-09-21T07:32:38.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 -- 172.21.15.60:0/1579042837 learned_addr learned my addr 172.21.15.60:0/1579042837 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd18a5640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bcc105380 0x7f7bcc102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd28a7640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc10de60 0x7f7bcc1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 -- 172.21.15.60:0/1579042837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bcc105380 msgr2=0x7f7bcc102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bcc105380 0x7f7bcc102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 -- 172.21.15.60:0/1579042837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc10de60 msgr2=0x7f7bcc1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc10de60 0x7f7bcc1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 -- 172.21.15.60:0/1579042837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc1a8680 con 0x7f7bcc104a30 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd28a7640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc10de60 0x7f7bcc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd20a6640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 0x7f7bcc102770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c970 tx=0x7f7bc800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8007c10 con 0x7f7bcc104a30 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bc8007db0 con 0x7f7bcc104a30 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc800f870 con 0x7f7bcc104a30 2024-09-21T07:32:38.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc1a8970 con 0x7f7bcc104a30 2024-09-21T07:32:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.252+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc1a8eb0 con 0x7f7bcc104a30 2024-09-21T07:32:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.253+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc06c1f0 con 0x7f7bcc104a30 2024-09-21T07:32:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.255+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7bc800fa10 con 0x7f7bcc104a30 2024-09-21T07:32:38.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.256+0000 7f7bc37fe640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7bb80b6510 0x7f7bb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.256+0000 7f7bd18a5640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7bb80b6510 0x7f7bb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.256+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f7bc80e73e0 con 0x7f7bcc104a30 2024-09-21T07:32:38.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.256+0000 7f7bd18a5640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7bb80b6510 0x7f7bb80b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc102400 tx=0x7f7bbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:38.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.259+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bc80ae230 con 0x7f7bcc104a30 2024-09-21T07:32:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:38 smithi060 ceph-mon[31244]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:38.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.496+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bcc103a70 con 0x7f7bcc104a30 2024-09-21T07:32:38.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.496+0000 7f7bc37fe640 1 -- 172.21.15.60:0/1579042837 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f7bc80b2610 con 0x7f7bcc104a30 2024-09-21T07:32:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:38.499 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"btime":"2024-09-21T07:32:36:669454+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T07:32:38.499 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 10 2024-09-21T07:32:38.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7bb80b6510 msgr2=0x7f7bb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7bb80b6510 0x7f7bb80b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc102400 tx=0x7f7bbc00b390 comp rx=0 tx=0).stop 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 msgr2=0x7f7bcc102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 0x7f7bcc102770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c970 tx=0x7f7bc800ce30 comp rx=0 tx=0).stop 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 shutdown_connections 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f7bb80b6510 0x7f7bb80b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc10de60 0x7f7bcc1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bcc105380 0x7f7bcc102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 --2- 172.21.15.60:0/1579042837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc104a30 0x7f7bcc102770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 >> 172.21.15.60:0/1579042837 conn(0x7f7bcc079760 msgr2=0x7f7bcc1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 shutdown_connections 2024-09-21T07:32:38.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:38.499+0000 7f7bd430a640 1 -- 172.21.15.60:0/1579042837 wait complete. 2024-09-21T07:32:38.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:38 smithi187 ceph-mon[34367]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:38.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:38 smithi123 ceph-mon[34166]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:39.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:39 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1579042837' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:39.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:39 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1579042837' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:39.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:39 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1579042837' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:39.621 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 07:32:39 smithi060 systemd[1]: Started Ceph mds.g for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:40.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:40 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:40.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:40.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:40 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:40 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:41.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:41.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:41 smithi060 ceph-mon[31244]: Deploying daemon mds.a on smithi060 2024-09-21T07:32:41.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:41 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.60:6838/349223669,v1:172.21.15.60:6839/349223669] up:boot 2024-09-21T07:32:41.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:41 smithi060 ceph-mon[31244]: fsmap 10 up:standby 2024-09-21T07:32:41.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:41 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:32:41.373 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 systemd[1]: Starting Ceph mds.a for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:41 smithi187 ceph-mon[34367]: Deploying daemon mds.a on smithi060 2024-09-21T07:32:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:41 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.60:6838/349223669,v1:172.21.15.60:6839/349223669] up:boot 2024-09-21T07:32:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:41 smithi187 ceph-mon[34367]: fsmap 10 up:standby 2024-09-21T07:32:41.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:41 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:32:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:41 smithi123 ceph-mon[34166]: Deploying daemon mds.a on smithi060 2024-09-21T07:32:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:41 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.60:6838/349223669,v1:172.21.15.60:6839/349223669] up:boot 2024-09-21T07:32:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:41 smithi123 ceph-mon[34166]: fsmap 10 up:standby 2024-09-21T07:32:41.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:41 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:32:41.736 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 podman[73205]: 2024-09-21 07:32:41.364821071 +0000 UTC m=+0.017688643 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:41.736 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 podman[73205]: 2024-09-21 07:32:41.490623653 +0000 UTC m=+0.143491211 container create 837237be24a2db59008a1f09bc63eba0bec496c8bb1d06e4b9b6efe757eb3342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:32:41.736 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 podman[73205]: 2024-09-21 07:32:41.735318434 +0000 UTC m=+0.388186002 container init 837237be24a2db59008a1f09bc63eba0bec496c8bb1d06e4b9b6efe757eb3342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:32:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:42.017 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 podman[73205]: 2024-09-21 07:32:41.738521997 +0000 UTC m=+0.391389564 container start 837237be24a2db59008a1f09bc63eba0bec496c8bb1d06e4b9b6efe757eb3342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:32:42.017 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 ceph-mds[73248]: -- 172.21.15.60:0/1880784917 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a66379c20 con 0x557a6a521a80 2024-09-21T07:32:42.017 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a[73233]: starting mds.a at 2024-09-21T07:32:42.017 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 bash[73205]: 837237be24a2db59008a1f09bc63eba0bec496c8bb1d06e4b9b6efe757eb3342 2024-09-21T07:32:42.017 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 07:32:41 smithi060 systemd[1]: Started Ceph mds.a for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:42.306 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:42.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:42.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:42.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:42 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 -- 172.21.15.60:0/2996682320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1641094a0 msgr2=0x7fe1641098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/2996682320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1641094a0 0x7fe1641098b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe154009900 tx=0x7fe15402a410 comp rx=0 tx=0).stop 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 -- 172.21.15.60:0/2996682320 shutdown_connections 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/2996682320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe164109df0 0x7fe164110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/2996682320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1641094a0 0x7fe1641098b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/2996682320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe164103b60 0x7fe164103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 -- 172.21.15.60:0/2996682320 >> 172.21.15.60:0/2996682320 conn(0x7fe16407b850 msgr2=0x7fe16407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:42.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 -- 172.21.15.60:0/2996682320 shutdown_connections 2024-09-21T07:32:42.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 -- 172.21.15.60:0/2996682320 wait complete. 2024-09-21T07:32:42.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.399+0000 7fe16bcdd640 1 Processor -- start 2024-09-21T07:32:42.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 -- start start 2024-09-21T07:32:42.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 0x7fe164075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1641094a0 0x7fe164075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe164109df0 0x7fe164076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe164113ab0 con 0x7fe164103b60 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe164113930 con 0x7fe1641094a0 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16bcdd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe164113c30 con 0x7fe164109df0 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 0x7fe164075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 0x7fe164075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40552/0 (socket says 172.21.15.60:40552) 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 -- 172.21.15.60:0/877352341 learned_addr learned my addr 172.21.15.60:0/877352341 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe16a27a640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe164109df0 0x7fe164076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169278640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1641094a0 0x7fe164075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 -- 172.21.15.60:0/877352341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe164109df0 msgr2=0x7fe164076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe164109df0 0x7fe164076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 -- 172.21.15.60:0/877352341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1641094a0 msgr2=0x7fe164075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1641094a0 0x7fe164075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169a79640 1 -- 172.21.15.60:0/877352341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1641a8790 con 0x7fe164103b60 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.400+0000 7fe169278640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1641094a0 0x7fe164075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.401+0000 7fe169a79640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 0x7fe164075710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe16000e9f0 tx=0x7fe16000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.401+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16000cd80 con 0x7fe164103b60 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.401+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1641a8a80 con 0x7fe164103b60 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.401+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1600108e0 con 0x7fe164103b60 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.401+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160018980 con 0x7fe164103b60 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.401+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1641a8fe0 con 0x7fe164103b60 2024-09-21T07:32:42.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.402+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe164103f70 con 0x7fe164103b60 2024-09-21T07:32:42.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.404+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe160010430 con 0x7fe164103b60 2024-09-21T07:32:42.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.404+0000 7fe15affd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1500b6590 0x7fe1500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:42.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.404+0000 7fe169278640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1500b6590 0x7fe1500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:42.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.404+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fe1600e7630 con 0x7fe164103b60 2024-09-21T07:32:42.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.405+0000 7fe169278640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1500b6590 0x7fe1500b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe154009230 tx=0x7fe154000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:42.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.408+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1600ae360 con 0x7fe164103b60 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:42.427 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:42 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:42.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:32:42.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:32:42.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:42 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:42.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.631+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe164076a10 con 0x7fe164103b60 2024-09-21T07:32:42.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.631+0000 7fe15affd640 1 -- 172.21.15.60:0/877352341 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7fe164076a10 con 0x7fe164103b60 2024-09-21T07:32:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:42.633 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":12,"btime":"2024-09-21T07:32:42:126034+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T07:32:42.634 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 12 2024-09-21T07:32:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1500b6590 msgr2=0x7fe1500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1500b6590 0x7fe1500b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe154009230 tx=0x7fe154000bc0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 msgr2=0x7fe164075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:42.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 0x7fe164075710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe16000e9f0 tx=0x7fe16000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 shutdown_connections 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1500b6590 0x7fe1500b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe164109df0 0x7fe164076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1641094a0 0x7fe164075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.633+0000 7fe16bcdd640 1 --2- 172.21.15.60:0/877352341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe164103b60 0x7fe164075710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.634+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 >> 172.21.15.60:0/877352341 conn(0x7fe16407b850 msgr2=0x7fe164105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.634+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 shutdown_connections 2024-09-21T07:32:42.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:42.634+0000 7fe16bcdd640 1 -- 172.21.15.60:0/877352341 wait complete. 2024-09-21T07:32:43.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:43 smithi060 ceph-mon[31244]: Deploying daemon mds.b on smithi123 2024-09-21T07:32:43.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:43 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.60:6840/2013963120,v1:172.21.15.60:6841/2013963120] up:boot 2024-09-21T07:32:43.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:43 smithi060 ceph-mon[31244]: fsmap 11 up:standby 2024-09-21T07:32:43.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:43 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:32:43.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:43 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/877352341' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:43.456 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:43 smithi123 ceph-mon[34166]: Deploying daemon mds.b on smithi123 2024-09-21T07:32:43.456 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:43 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.60:6840/2013963120,v1:172.21.15.60:6841/2013963120] up:boot 2024-09-21T07:32:43.456 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:43 smithi123 ceph-mon[34166]: fsmap 11 up:standby 2024-09-21T07:32:43.457 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:43 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:32:43.457 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:43 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/877352341' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:43.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:43 smithi187 ceph-mon[34367]: Deploying daemon mds.b on smithi123 2024-09-21T07:32:43.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:43 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.60:6840/2013963120,v1:172.21.15.60:6841/2013963120] up:boot 2024-09-21T07:32:43.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:43 smithi187 ceph-mon[34367]: fsmap 11 up:standby 2024-09-21T07:32:43.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:43 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:32:43.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:43 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/877352341' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:43.849 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:43 smithi123 systemd[1]: Starting Ceph mds.b for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T07:32:44.142 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:43 smithi123 podman[62982]: 2024-09-21 07:32:43.78767847 +0000 UTC m=+0.015917580 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:32:44.142 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:43 smithi123 podman[62982]: 2024-09-21 07:32:43.912810778 +0000 UTC m=+0.141049872 container create 10e6b19890ce8e197e478b3392bcd5b836f1b5b0188a1229d8fbdc3f0ea5ac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:32:44.143 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:44 smithi123 podman[62982]: 2024-09-21 07:32:44.123197113 +0000 UTC m=+0.351436208 container init 10e6b19890ce8e197e478b3392bcd5b836f1b5b0188a1229d8fbdc3f0ea5ac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:32:44.143 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:44 smithi123 podman[62982]: 2024-09-21 07:32:44.12605933 +0000 UTC m=+0.354298424 container start 10e6b19890ce8e197e478b3392bcd5b836f1b5b0188a1229d8fbdc3f0ea5ac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T07:32:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:44 smithi187 ceph-mon[34367]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:44.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:44 smithi123 ceph-mon[34166]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:44.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:44 smithi123 ceph-mds[63001]: -- 172.21.15.123:0/3342312022 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561963e0d860 con 0x561967fb5a80 2024-09-21T07:32:44.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: starting mds.b at 2024-09-21T07:32:44.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:44 smithi123 bash[62982]: 10e6b19890ce8e197e478b3392bcd5b836f1b5b0188a1229d8fbdc3f0ea5ac4a 2024-09-21T07:32:44.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:32:44 smithi123 systemd[1]: Started Ceph mds.b for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T07:32:44.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:44 smithi060 ceph-mon[31244]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:45.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:32:45.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:45.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] up:boot 2024-09-21T07:32:45.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: fsmap 12 up:standby 2024-09-21T07:32:45.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:45 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:32:45.548 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:45.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] up:boot 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: fsmap 12 up:standby 2024-09-21T07:32:45.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:45 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:32:45.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:45.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:45.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] up:boot 2024-09-21T07:32:45.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: fsmap 12 up:standby 2024-09-21T07:32:45.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:45 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:32:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 -- 172.21.15.60:0/3939479942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff938103b60 msgr2=0x7ff938103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3939479942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff938103b60 0x7ff938103f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff928009900 tx=0x7ff92802a410 comp rx=0 tx=0).stop 2024-09-21T07:32:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 -- 172.21.15.60:0/3939479942 shutdown_connections 2024-09-21T07:32:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3939479942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff938109df0 0x7ff938110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3939479942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9381094a0 0x7ff9381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3939479942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff938103b60 0x7ff938103f70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 -- 172.21.15.60:0/3939479942 >> 172.21.15.60:0/3939479942 conn(0x7ff93807b850 msgr2=0x7ff93807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 -- 172.21.15.60:0/3939479942 shutdown_connections 2024-09-21T07:32:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.050+0000 7ff93e1be640 1 -- 172.21.15.60:0/3939479942 wait complete. 2024-09-21T07:32:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 Processor -- start 2024-09-21T07:32:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 -- start start 2024-09-21T07:32:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff938103b60 0x7ff93819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 0x7ff93819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff938109df0 0x7ff9381a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff938113b00 con 0x7ff9381094a0 2024-09-21T07:32:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff938113980 con 0x7ff938109df0 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff93e1be640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff938113c80 con 0x7ff938103b60 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff936ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 0x7ff93819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff936ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 0x7ff93819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40576/0 (socket says 172.21.15.60:40576) 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff936ffd640 1 -- 172.21.15.60:0/3840810901 learned_addr learned my addr 172.21.15.60:0/3840810901 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.051+0000 7ff9377fe640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff938103b60 0x7ff93819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff937fff640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff938109df0 0x7ff9381a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff936ffd640 1 -- 172.21.15.60:0/3840810901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff938103b60 msgr2=0x7ff93819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff936ffd640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff938103b60 0x7ff93819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff936ffd640 1 -- 172.21.15.60:0/3840810901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff938109df0 msgr2=0x7ff9381a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff936ffd640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff938109df0 0x7ff9381a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff936ffd640 1 -- 172.21.15.60:0/3840810901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9381a25e0 con 0x7ff9381094a0 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff936ffd640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 0x7ff93819cc10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00d950 tx=0x7ff92c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c017070 con 0x7ff9381094a0 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9381a28d0 con 0x7ff9381094a0 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff92c009c30 con 0x7ff9381094a0 2024-09-21T07:32:46.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0047a0 con 0x7ff9381094a0 2024-09-21T07:32:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.052+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9381a9030 con 0x7ff9381094a0 2024-09-21T07:32:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.053+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff938103f70 con 0x7ff9381094a0 2024-09-21T07:32:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.055+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff92c004020 con 0x7ff9381094a0 2024-09-21T07:32:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.056+0000 7ff934ff9640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9200b6590 0x7ff9200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.056+0000 7ff9377fe640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9200b6590 0x7ff9200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.056+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7ff92c0e6ec0 con 0x7ff9381094a0 2024-09-21T07:32:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.057+0000 7ff9377fe640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9200b6590 0x7ff9200b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff928005ab0 tx=0x7ff928005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:46.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.060+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff92c020020 con 0x7ff9381094a0 2024-09-21T07:32:46.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.331+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff93819d7a0 con 0x7ff9381094a0 2024-09-21T07:32:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.332+0000 7ff934ff9640 1 -- 172.21.15.60:0/3840810901 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7ff93819d7a0 con 0x7ff9381094a0 2024-09-21T07:32:46.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:46.334 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":13,"btime":"2024-09-21T07:32:45:140936+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24586,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24613,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24623,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T07:32:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-09-21T07:32:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9200b6590 msgr2=0x7ff9200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9200b6590 0x7ff9200b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff928005ab0 tx=0x7ff928005a20 comp rx=0 tx=0).stop 2024-09-21T07:32:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 msgr2=0x7ff93819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 0x7ff93819cc10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00d950 tx=0x7ff92c00de10 comp rx=0 tx=0).stop 2024-09-21T07:32:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 shutdown_connections 2024-09-21T07:32:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff9200b6590 0x7ff9200b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff938109df0 0x7ff9381a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9381094a0 0x7ff93819cc10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 --2- 172.21.15.60:0/3840810901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff938103b60 0x7ff93819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:46.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 >> 172.21.15.60:0/3840810901 conn(0x7ff93807b850 msgr2=0x7ff9381072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:46.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 shutdown_connections 2024-09-21T07:32:46.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:46.334+0000 7ff93e1be640 1 -- 172.21.15.60:0/3840810901 wait complete. 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:46.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:46.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:46 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:46.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:46.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:46 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:46.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:46 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:46.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T07:32:47.549 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:47 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:47.549 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:47 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3840810901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:47.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:47 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:47.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:47 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3840810901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:47.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:47 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:32:47.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:47 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3840810901' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:32:47.857 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 -- 172.21.15.60:0/1133379677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc1094c0 msgr2=0x7fbafc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1133379677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc1094c0 0x7fbafc1098d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009900 tx=0x7fbaf002a410 comp rx=0 tx=0).stop 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 -- 172.21.15.60:0/1133379677 shutdown_connections 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1133379677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbafc109e10 0x7fbafc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1133379677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc1094c0 0x7fbafc1098d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1133379677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbafc103b80 0x7fbafc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 -- 172.21.15.60:0/1133379677 >> 172.21.15.60:0/1133379677 conn(0x7fbafc0ff610 msgr2=0x7fbafc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 -- 172.21.15.60:0/1133379677 shutdown_connections 2024-09-21T07:32:48.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 -- 172.21.15.60:0/1133379677 wait complete. 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.336+0000 7fbb0213f640 1 Processor -- start 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 -- start start 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 0x7fbafc19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbafc1094c0 0x7fbafc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbafc109e10 0x7fbafc1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc113ad0 con 0x7fbafc103b80 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc113950 con 0x7fbafc109e10 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbb0213f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc113c50 con 0x7fbafc1094c0 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 0x7fbafc19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 0x7fbafc19c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58740/0 (socket says 172.21.15.60:58740) 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 -- 172.21.15.60:0/1545437554 learned_addr learned my addr 172.21.15.60:0/1545437554 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafbfff640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbafc109e10 0x7fbafc1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafaffd640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbafc1094c0 0x7fbafc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 -- 172.21.15.60:0/1545437554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbafc1094c0 msgr2=0x7fbafc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbafc1094c0 0x7fbafc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 -- 172.21.15.60:0/1545437554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbafc109e10 msgr2=0x7fbafc1a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbafc109e10 0x7fbafc1a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.337+0000 7fbafb7fe640 1 -- 172.21.15.60:0/1545437554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc1a2650 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.338+0000 7fbafb7fe640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 0x7fbafc19c6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00e9f0 tx=0x7fbaec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.338+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00cd80 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.338+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaec0054d0 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.338+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec010690 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.338+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc1a2940 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.338+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc1a90a0 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.339+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc103f90 con 0x7fbafc103b80 2024-09-21T07:32:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.341+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbaec004e30 con 0x7fbafc103b80 2024-09-21T07:32:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.341+0000 7fbaf8ff9640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbae40b6510 0x7fbae40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.342+0000 7fbafaffd640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbae40b6510 0x7fbae40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.342+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fbaec0e7400 con 0x7fbafc103b80 2024-09-21T07:32:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.342+0000 7fbafaffd640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbae40b6510 0x7fbae40b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009230 tx=0x7fbaf0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.345+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbaec0ae130 con 0x7fbafc103b80 2024-09-21T07:32:48.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.546+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbafc19d810 con 0x7fbafc103b80 2024-09-21T07:32:48.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:48 smithi060 ceph-mon[31244]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:48.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:48 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.546+0000 7fbaf8ff9640 1 -- 172.21.15.60:0/1545437554 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7fbafc19d810 con 0x7fbafc103b80 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:32:48.549 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-21T07:32:48.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.548+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbae40b6510 msgr2=0x7fbae40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.548+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbae40b6510 0x7fbae40b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009230 tx=0x7fbaf0031400 comp rx=0 tx=0).stop 2024-09-21T07:32:48.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.548+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 msgr2=0x7fbafc19c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:48.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.548+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 0x7fbafc19c6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00e9f0 tx=0x7fbaec00edf0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 shutdown_connections 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbae40b6510 0x7fbae40b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbafc109e10 0x7fbafc1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbafc1094c0 0x7fbafc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 --2- 172.21.15.60:0/1545437554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbafc103b80 0x7fbafc19c6e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 >> 172.21.15.60:0/1545437554 conn(0x7fbafc0ff610 msgr2=0x7fbafc106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 shutdown_connections 2024-09-21T07:32:48.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:48.549+0000 7fbb0213f640 1 -- 172.21.15.60:0/1545437554 wait complete. 2024-09-21T07:32:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:48 smithi123 ceph-mon[34166]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:48 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.671 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:48 smithi187 ceph-mon[34367]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:48.671 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.671 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.671 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.671 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:48.671 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:48 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.156 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:32:49.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:32:49.425 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:49.547 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:49 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1545437554' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:32:49.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:49.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:49.548 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:49 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1545437554' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:32:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:49.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:49 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1545437554' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:32:49.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:32:49.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:32:49.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/270033668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 msgr2=0x7fbcb0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/270033668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb0109900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009900 tx=0x7fbca402a410 comp rx=0 tx=0).stop 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/270033668 shutdown_connections 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/270033668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0109e40 0x7fbcb0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/270033668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb0109900 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/270033668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcb0103bb0 0x7fbcb0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/270033668 >> 172.21.15.60:0/270033668 conn(0x7fbcb00ff600 msgr2=0x7fbcb0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:49.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/270033668 shutdown_connections 2024-09-21T07:32:49.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.888+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/270033668 wait complete. 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 Processor -- start 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 -- start start 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0103bb0 0x7fbcb019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcb0109e40 0x7fbcb019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb0113b00 con 0x7fbcb01094f0 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb0113980 con 0x7fbcb0109e40 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcb5a4a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb0113c80 con 0x7fbcb0103bb0 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcae7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcae7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58762/0 (socket says 172.21.15.60:58762) 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcae7fc640 1 -- 172.21.15.60:0/384431144 learned_addr learned my addr 172.21.15.60:0/384431144 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcaeffd640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0103bb0 0x7fbcb019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.889+0000 7fbcaf7fe640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcb0109e40 0x7fbcb019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcae7fc640 1 -- 172.21.15.60:0/384431144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0103bb0 msgr2=0x7fbcb019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcae7fc640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0103bb0 0x7fbcb019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcae7fc640 1 -- 172.21.15.60:0/384431144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcb0109e40 msgr2=0x7fbcb019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcae7fc640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcb0109e40 0x7fbcb019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcae7fc640 1 -- 172.21.15.60:0/384431144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb01a04a0 con 0x7fbcb01094f0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcaeffd640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0103bb0 0x7fbcb019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcae7fc640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb019aad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbca4006010 tx=0x7fbca4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca403f030 con 0x7fbcb01094f0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb01a0730 con 0x7fbcb01094f0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbca4003aa0 con 0x7fbcb01094f0 2024-09-21T07:32:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4035070 con 0x7fbcb01094f0 2024-09-21T07:32:49.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.890+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb01a6ef0 con 0x7fbcb01094f0 2024-09-21T07:32:49.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.891+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb0104e30 con 0x7fbcb01094f0 2024-09-21T07:32:49.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.893+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbca4042030 con 0x7fbcb01094f0 2024-09-21T07:32:49.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.894+0000 7fbcb4a48640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbc980b6510 0x7fbc980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:49.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.894+0000 7fbcaeffd640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbc980b6510 0x7fbc980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:49.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.894+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fbca4107640 con 0x7fbcb01094f0 2024-09-21T07:32:49.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.894+0000 7fbcaeffd640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbc980b6510 0x7fbc980b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009fd0 tx=0x7fbca0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:49.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:49.897+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbca40d2730 con 0x7fbcb01094f0 2024-09-21T07:32:50.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.086+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbcb010bc30 con 0x7fbcb01094f0 2024-09-21T07:32:50.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.301+0000 7fbcb4a48640 1 -- 172.21.15.60:0/384431144 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7fbca40d7670 con 0x7fbcb01094f0 2024-09-21T07:32:50.303 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbc980b6510 msgr2=0x7fbc980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbc980b6510 0x7fbc980b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009fd0 tx=0x7fbca0009680 comp rx=0 tx=0).stop 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 msgr2=0x7fbcb019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb019aad0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbca4006010 tx=0x7fbca4004060 comp rx=0 tx=0).stop 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 shutdown_connections 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbc980b6510 0x7fbc980b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbcb0109e40 0x7fbcb019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb01094f0 0x7fbcb019aad0 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbca4006010 tx=0x7fbca4004060 comp rx=0 tx=0).stop 2024-09-21T07:32:50.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 --2- 172.21.15.60:0/384431144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcb0103bb0 0x7fbcb019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:50.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.304+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 >> 172.21.15.60:0/384431144 conn(0x7fbcb00ff600 msgr2=0x7fbcb0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:50.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.305+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 shutdown_connections 2024-09-21T07:32:50.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:50.305+0000 7fbcb5a4a640 1 -- 172.21.15.60:0/384431144 wait complete. 2024-09-21T07:32:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:50 smithi123 ceph-mon[34166]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:50.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:50 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/384431144' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:32:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:50 smithi060 ceph-mon[31244]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:50 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/384431144' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:32:50.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:50 smithi187 ceph-mon[34367]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:50.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:50 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/384431144' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:32:50.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:32:51.245 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:51.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:51 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/384431144' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:32:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:51 smithi123 ceph-mon[34166]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:32:51.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:51 smithi123 ceph-mon[34166]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:32:51.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:51 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/384431144' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:32:51.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:51 smithi060 ceph-mon[31244]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:32:51.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:51 smithi060 ceph-mon[31244]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 -- 172.21.15.60:0/1084922087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 msgr2=0x7efe8c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 --2- 172.21.15.60:0/1084922087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c110330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe84009ca0 tx=0x7efe8402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 -- 172.21.15.60:0/1084922087 shutdown_connections 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 --2- 172.21.15.60:0/1084922087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c110330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 --2- 172.21.15.60:0/1084922087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe8c105380 0x7efe8c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 --2- 172.21.15.60:0/1084922087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8c104a30 0x7efe8c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 -- 172.21.15.60:0/1084922087 >> 172.21.15.60:0/1084922087 conn(0x7efe8c079760 msgr2=0x7efe8c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 -- 172.21.15.60:0/1084922087 shutdown_connections 2024-09-21T07:32:51.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.741+0000 7efe937df640 1 -- 172.21.15.60:0/1084922087 wait complete. 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 Processor -- start 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 -- start start 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe8c104a30 0x7efe8c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8c105380 0x7efe8c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c113ac0 con 0x7efe8c10de60 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c113940 con 0x7efe8c104a30 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.742+0000 7efe937df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c113c40 con 0x7efe8c105380 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c19fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58780/0 (socket says 172.21.15.60:58780) 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 -- 172.21.15.60:0/1373731958 learned_addr learned my addr 172.21.15.60:0/1373731958 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe9157b640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe8c104a30 0x7efe8c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe90d7a640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8c105380 0x7efe8c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 -- 172.21.15.60:0/1373731958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8c105380 msgr2=0x7efe8c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8c105380 0x7efe8c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 -- 172.21.15.60:0/1373731958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe8c104a30 msgr2=0x7efe8c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe8c104a30 0x7efe8c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 -- 172.21.15.60:0/1373731958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c1a03a0 con 0x7efe8c10de60 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe91d7c640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c19fc70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe84005cc0 tx=0x7efe8402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84003bf0 con 0x7efe8c10de60 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe84003d90 con 0x7efe8c10de60 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8c1a0630 con 0x7efe8c10de60 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.743+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8402fbc0 con 0x7efe8c10de60 2024-09-21T07:32:51.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.744+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8c1a6df0 con 0x7efe8c10de60 2024-09-21T07:32:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.745+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8c06c1f0 con 0x7efe8c10de60 2024-09-21T07:32:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.746+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efe8402fd60 con 0x7efe8c10de60 2024-09-21T07:32:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.747+0000 7efe8a7fc640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe740b6590 0x7efe740b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.747+0000 7efe9157b640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe740b6590 0x7efe740b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.747+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7efe84108590 con 0x7efe8c10de60 2024-09-21T07:32:51.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.748+0000 7efe9157b640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe740b6590 0x7efe740b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efe7c005fd0 tx=0x7efe7c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:51.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.750+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe840cf0b0 con 0x7efe8c10de60 2024-09-21T07:32:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:51 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/384431144' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:32:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:51 smithi187 ceph-mon[34367]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:32:51.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:51 smithi187 ceph-mon[34367]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:32:51.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:51.939+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efe8c104e40 con 0x7efe8c10de60 2024-09-21T07:32:52.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.305+0000 7efe8a7fc640 1 -- 172.21.15.60:0/1373731958 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7efe8c104e40 con 0x7efe8c10de60 2024-09-21T07:32:52.308 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-21T07:32:52.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe740b6590 msgr2=0x7efe740b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe740b6590 0x7efe740b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efe7c005fd0 tx=0x7efe7c00b390 comp rx=0 tx=0).stop 2024-09-21T07:32:52.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 msgr2=0x7efe8c19fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:52.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c19fc70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe84005cc0 tx=0x7efe8402f380 comp rx=0 tx=0).stop 2024-09-21T07:32:52.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 shutdown_connections 2024-09-21T07:32:52.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe740b6590 0x7efe740b8aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c10de60 0x7efe8c19fc70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8c105380 0x7efe8c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 --2- 172.21.15.60:0/1373731958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe8c104a30 0x7efe8c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:52.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 >> 172.21.15.60:0/1373731958 conn(0x7efe8c079760 msgr2=0x7efe8c105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:52.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 shutdown_connections 2024-09-21T07:32:52.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:52.308+0000 7efe937df640 1 -- 172.21.15.60:0/1373731958 wait complete. 2024-09-21T07:32:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:52 smithi123 ceph-mon[34166]: pgmap v279: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:52 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1373731958' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:32:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:52 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1373731958' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:32:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:52 smithi123 ceph-mon[34166]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:32:52.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:52 smithi060 ceph-mon[31244]: pgmap v279: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:52.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:52 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1373731958' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:32:52.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:52 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1373731958' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:32:52.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:52 smithi060 ceph-mon[31244]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:32:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:52 smithi187 ceph-mon[34367]: pgmap v279: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:52 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1373731958' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:32:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:52 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1373731958' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:32:52.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:52 smithi187 ceph-mon[34367]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:32:52.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:32:53.239 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2525337620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8108cf0 msgr2=0x7ff1a810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2525337620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8108cf0 0x7ff1a810f520 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009ca0 tx=0x7ff1a002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2525337620 shutdown_connections 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2525337620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8108cf0 0x7ff1a810f520 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2525337620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1a81083a0 0x7ff1a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2525337620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1a8102a60 0x7ff1a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2525337620 >> 172.21.15.60:0/2525337620 conn(0x7ff1a8079730 msgr2=0x7ff1a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2525337620 shutdown_connections 2024-09-21T07:32:53.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.680+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2525337620 wait complete. 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 Processor -- start 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 -- start start 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 0x7ff1a80ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1a81083a0 0x7ff1a80ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1a8108cf0 0x7ff1a81000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8112960 con 0x7ff1a8102a60 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81127e0 con 0x7ff1a81083a0 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1adfcd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8112ae0 con 0x7ff1a8108cf0 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 0x7ff1a80ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 0x7ff1a80ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58796/0 (socket says 172.21.15.60:58796) 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1a77fe640 1 -- 172.21.15.60:0/2027384599 learned_addr learned my addr 172.21.15.60:0/2027384599 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1a6ffd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1a81083a0 0x7ff1a80ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.681+0000 7ff1a7fff640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1a8108cf0 0x7ff1a81000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a77fe640 1 -- 172.21.15.60:0/2027384599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1a8108cf0 msgr2=0x7ff1a81000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a77fe640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1a8108cf0 0x7ff1a81000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a77fe640 1 -- 172.21.15.60:0/2027384599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1a81083a0 msgr2=0x7ff1a80ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a77fe640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1a81083a0 0x7ff1a80ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a77fe640 1 -- 172.21.15.60:0/2027384599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a81a87a0 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a77fe640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 0x7ff1a80ff670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c890 tx=0x7ff19800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198004220 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a81a8a90 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1980043c0 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198004a00 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.682+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a81a8fd0 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.683+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a8102e70 con 0x7ff1a8102a60 2024-09-21T07:32:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.685+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff1980079b0 con 0x7ff1a8102a60 2024-09-21T07:32:53.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.686+0000 7ff1a4ff9640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff1900b6510 0x7ff1900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:53.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.686+0000 7ff1a6ffd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff1900b6510 0x7ff1900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:53.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.686+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7879+0+0 (secure 0 0 0) 0x7ff1980e72a0 con 0x7ff1a8102a60 2024-09-21T07:32:53.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.686+0000 7ff1a6ffd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff1900b6510 0x7ff1900b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1a81025a0 tx=0x7ff19c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:53.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.689+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff198014030 con 0x7ff1a8102a60 2024-09-21T07:32:53.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:53.916+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff1a8100970 con 0x7ff1a8102a60 2024-09-21T07:32:54.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.329+0000 7ff1a4ff9640 1 -- 172.21.15.60:0/2027384599 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff1980b2020 con 0x7ff1a8102a60 2024-09-21T07:32:54.332 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff1900b6510 msgr2=0x7ff1900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff1900b6510 0x7ff1900b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1a81025a0 tx=0x7ff19c00b390 comp rx=0 tx=0).stop 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 msgr2=0x7ff1a80ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 0x7ff1a80ff670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c890 tx=0x7ff19800cd50 comp rx=0 tx=0).stop 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 shutdown_connections 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff1900b6510 0x7ff1900b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1a8108cf0 0x7ff1a81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff1a81083a0 0x7ff1a80ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 --2- 172.21.15.60:0/2027384599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8102a60 0x7ff1a80ff670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 >> 172.21.15.60:0/2027384599 conn(0x7ff1a8079730 msgr2=0x7ff1a806b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 shutdown_connections 2024-09-21T07:32:54.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:54.332+0000 7ff1adfcd640 1 -- 172.21.15.60:0/2027384599 wait complete. 2024-09-21T07:32:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:54 smithi123 ceph-mon[34166]: pgmap v282: 97 pgs: 2 creating+activating, 9 creating+peering, 72 unknown, 14 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:54 smithi123 ceph-mon[34166]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:32:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:54 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2027384599' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:32:54.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:54 smithi123 ceph-mon[34166]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:32:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:54 smithi060 ceph-mon[31244]: pgmap v282: 97 pgs: 2 creating+activating, 9 creating+peering, 72 unknown, 14 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:54 smithi060 ceph-mon[31244]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:32:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:54 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2027384599' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:32:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:54 smithi060 ceph-mon[31244]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:32:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:54 smithi187 ceph-mon[34367]: pgmap v282: 97 pgs: 2 creating+activating, 9 creating+peering, 72 unknown, 14 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:54 smithi187 ceph-mon[34367]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:32:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:54 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2027384599' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:32:54.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:54 smithi187 ceph-mon[34367]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:32:54.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:32:55.248 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:55.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:55 smithi123 ceph-mon[34166]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:32:55.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:55 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2027384599' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:32:55.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:55 smithi123 ceph-mon[34166]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:32:55.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:55 smithi123 ceph-mon[34166]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:32:55.608 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:55 smithi060 ceph-mon[31244]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:32:55.608 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:55 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2027384599' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:32:55.608 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:55 smithi060 ceph-mon[31244]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:32:55.608 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:55 smithi060 ceph-mon[31244]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 -- 172.21.15.60:0/796506430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 msgr2=0x7f040410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 --2- 172.21.15.60:0/796506430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040410d870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009900 tx=0x7f03f402a410 comp rx=0 tx=0).stop 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 -- 172.21.15.60:0/796506430 shutdown_connections 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 --2- 172.21.15.60:0/796506430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040410de30 0x7f0404110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 --2- 172.21.15.60:0/796506430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040410d870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 --2- 172.21.15.60:0/796506430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04041049d0 0x7f0404104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 -- 172.21.15.60:0/796506430 >> 172.21.15.60:0/796506430 conn(0x7f0404079740 msgr2=0x7f0404079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 -- 172.21.15.60:0/796506430 shutdown_connections 2024-09-21T07:32:55.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.698+0000 7f0409eb1640 1 -- 172.21.15.60:0/796506430 wait complete. 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.699+0000 7f0409eb1640 1 Processor -- start 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.699+0000 7f0409eb1640 1 -- start start 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0409eb1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04041049d0 0x7f040419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0409eb1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0409eb1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f040410de30 0x7f040419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0409eb1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0404113ae0 con 0x7f0404105320 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0409eb1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0404113960 con 0x7f040410de30 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0409eb1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0404113c60 con 0x7f04041049d0 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58816/0 (socket says 172.21.15.60:58816) 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 -- 172.21.15.60:0/4016047362 learned_addr learned my addr 172.21.15.60:0/4016047362 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f04037fe640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04041049d0 0x7f040419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0403fff640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f040410de30 0x7f040419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 -- 172.21.15.60:0/4016047362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04041049d0 msgr2=0x7f040419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04041049d0 0x7f040419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 -- 172.21.15.60:0/4016047362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f040410de30 msgr2=0x7f040419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f040410de30 0x7f040419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 -- 172.21.15.60:0/4016047362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041a0420 con 0x7f0404105320 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.700+0000 7f0402ffd640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040419aa50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03f4005ab0 tx=0x7f03f4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.701+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f403f070 con 0x7f0404105320 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.701+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f4031b50 con 0x7f0404105320 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.701+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04041a06b0 con 0x7f0404105320 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.701+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4035030 con 0x7f0404105320 2024-09-21T07:32:55.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.701+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04041a6e70 con 0x7f0404105320 2024-09-21T07:32:55.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.702+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040406c240 con 0x7f0404105320 2024-09-21T07:32:55.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.704+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f03f4042070 con 0x7f0404105320 2024-09-21T07:32:55.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.704+0000 7f0400ff9640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03f00b6510 0x7f03f00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:55.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.704+0000 7f04037fe640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03f00b6510 0x7f03f00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:55.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.705+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f03f4107f40 con 0x7f0404105320 2024-09-21T07:32:55.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.705+0000 7f04037fe640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03f00b6510 0x7f03f00b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f040406c940 tx=0x7f03ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:55.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.708+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03f40d2d00 con 0x7f0404105320 2024-09-21T07:32:55.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:55 smithi187 ceph-mon[34367]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:32:55.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:55 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2027384599' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:32:55.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:55 smithi187 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:32:55.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:55 smithi187 ceph-mon[34367]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:32:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.895+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0404108f90 con 0x7f0404105320 2024-09-21T07:32:55.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.897+0000 7f0400ff9640 1 -- 172.21.15.60:0/4016047362 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22266 (secure 0 0 0) 0x7f03f40d7c40 con 0x7f0404105320 2024-09-21T07:32:55.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:55.899 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:32:53.917839+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03f00b6510 msgr2=0x7f03f00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03f00b6510 0x7f03f00b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f040406c940 tx=0x7f03ec005f90 comp rx=0 tx=0).stop 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 msgr2=0x7f040419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040419aa50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03f4005ab0 tx=0x7f03f4003b90 comp rx=0 tx=0).stop 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 shutdown_connections 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03f00b6510 0x7f03f00b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f040410de30 0x7f040419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0404105320 0x7f040419aa50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 --2- 172.21.15.60:0/4016047362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04041049d0 0x7f040419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 >> 172.21.15.60:0/4016047362 conn(0x7f0404079740 msgr2=0x7f04041007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 shutdown_connections 2024-09-21T07:32:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:55.899+0000 7f0409eb1640 1 -- 172.21.15.60:0/4016047362 wait complete. 2024-09-21T07:32:56.493 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:56 smithi060 ceph-mon[31244]: pgmap v285: 97 pgs: 2 creating+activating, 29 creating+peering, 34 unknown, 32 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:56.493 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:56 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] up:active 2024-09-21T07:32:56.493 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:56 smithi060 ceph-mon[31244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:32:56.493 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:56 smithi060 ceph-mon[31244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:32:56.493 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:56 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4016047362' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:56.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:32:56.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:56 smithi123 ceph-mon[34166]: pgmap v285: 97 pgs: 2 creating+activating, 29 creating+peering, 34 unknown, 32 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:56.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:56 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] up:active 2024-09-21T07:32:56.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:56 smithi123 ceph-mon[34166]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:32:56.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:56 smithi123 ceph-mon[34166]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:32:56.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:56 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4016047362' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:56.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:56 smithi187 ceph-mon[34367]: pgmap v285: 97 pgs: 2 creating+activating, 29 creating+peering, 34 unknown, 32 active+clean; 577 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:32:56.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:56 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] up:active 2024-09-21T07:32:56.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:56 smithi187 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:32:56.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:56 smithi187 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:32:56.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:56 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4016047362' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:56.793 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 -- 172.21.15.60:0/819145073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc109df0 msgr2=0x7f1cfc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/819145073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc109df0 0x7f1cfc110620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009ca0 tx=0x7f1cf402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 -- 172.21.15.60:0/819145073 shutdown_connections 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/819145073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc109df0 0x7f1cfc110620 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/819145073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/819145073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cfc103b60 0x7f1cfc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 -- 172.21.15.60:0/819145073 >> 172.21.15.60:0/819145073 conn(0x7f1cfc07b850 msgr2=0x7f1cfc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 -- 172.21.15.60:0/819145073 shutdown_connections 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.228+0000 7f1d01bd8640 1 -- 172.21.15.60:0/819145073 wait complete. 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 Processor -- start 2024-09-21T07:32:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 -- start start 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cfc103b60 0x7f1cfc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cfc109df0 0x7f1cfc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc113ab0 con 0x7f1cfc1094a0 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc113930 con 0x7f1cfc103b60 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1d01bd8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc113c30 con 0x7f1cfc109df0 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1cfaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1cfaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33874/0 (socket says 172.21.15.60:33874) 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1cfaffd640 1 -- 172.21.15.60:0/2738056861 learned_addr learned my addr 172.21.15.60:0/2738056861 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1cfb7fe640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cfc103b60 0x7f1cfc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:57.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.229+0000 7f1cfbfff640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cfc109df0 0x7f1cfc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cfaffd640 1 -- 172.21.15.60:0/2738056861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cfc109df0 msgr2=0x7f1cfc19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cfaffd640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cfc109df0 0x7f1cfc19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cfaffd640 1 -- 172.21.15.60:0/2738056861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cfc103b60 msgr2=0x7f1cfc19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cfaffd640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cfc103b60 0x7f1cfc19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cfaffd640 1 -- 172.21.15.60:0/2738056861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc1a03f0 con 0x7f1cfc1094a0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cfaffd640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc19aa20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000d950 tx=0x7f1cf000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0017070 con 0x7f1cfc1094a0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc1a06e0 con 0x7f1cfc1094a0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf0009c30 con 0x7f1cfc1094a0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00047a0 con 0x7f1cfc1094a0 2024-09-21T07:32:57.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.230+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc1a6e40 con 0x7f1cfc1094a0 2024-09-21T07:32:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.232+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cfc103f70 con 0x7f1cfc1094a0 2024-09-21T07:32:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.233+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1cf0004020 con 0x7f1cfc1094a0 2024-09-21T07:32:57.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.234+0000 7f1cf8ff9640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1ce40b6510 0x7f1ce40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:57.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.234+0000 7f1cfb7fe640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1ce40b6510 0x7f1ce40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:57.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.234+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f1cf00e6ea0 con 0x7f1cfc1094a0 2024-09-21T07:32:57.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.234+0000 7f1cfb7fe640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1ce40b6510 0x7f1ce40b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cec005fd0 tx=0x7f1cec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:57.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.238+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cf0020020 con 0x7f1cfc1094a0 2024-09-21T07:32:57.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.426+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cfc10bc40 con 0x7f1cfc1094a0 2024-09-21T07:32:57.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.427+0000 7f1cf8ff9640 1 -- 172.21.15.60:0/2738056861 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22266 (secure 0 0 0) 0x7f1cf00ad880 con 0x7f1cfc1094a0 2024-09-21T07:32:57.430 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:32:57.430 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:32:53.917839+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1ce40b6510 msgr2=0x7f1ce40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1ce40b6510 0x7f1ce40b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cec005fd0 tx=0x7f1cec005850 comp rx=0 tx=0).stop 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 msgr2=0x7f1cfc19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc19aa20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000d950 tx=0x7f1cf000de10 comp rx=0 tx=0).stop 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 shutdown_connections 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1ce40b6510 0x7f1ce40b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cfc109df0 0x7f1cfc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1cfc1094a0 0x7f1cfc19aa20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 --2- 172.21.15.60:0/2738056861 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cfc103b60 0x7f1cfc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:57.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 >> 172.21.15.60:0/2738056861 conn(0x7f1cfc07b850 msgr2=0x7f1cfc105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:57.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 shutdown_connections 2024-09-21T07:32:57.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:57.430+0000 7f1d01bd8640 1 -- 172.21.15.60:0/2738056861 wait complete. 2024-09-21T07:32:58.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:32:58.330 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:32:58.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:58 smithi060 ceph-mon[31244]: pgmap v286: 97 pgs: 1 creating+activating, 26 creating+peering, 14 unknown, 56 active+clean; 578 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 580 B/s wr, 1 op/s 2024-09-21T07:32:58.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:58 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2738056861' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:58.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:58 smithi123 ceph-mon[34166]: pgmap v286: 97 pgs: 1 creating+activating, 26 creating+peering, 14 unknown, 56 active+clean; 578 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 580 B/s wr, 1 op/s 2024-09-21T07:32:58.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:58 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2738056861' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:58.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:58 smithi187 ceph-mon[34367]: pgmap v286: 97 pgs: 1 creating+activating, 26 creating+peering, 14 unknown, 56 active+clean; 578 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 580 B/s wr, 1 op/s 2024-09-21T07:32:58.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:58 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2738056861' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:32:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 -- 172.21.15.60:0/1449468503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610103b60 msgr2=0x7f1610103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 --2- 172.21.15.60:0/1449468503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610103b60 0x7f1610103f70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1600009900 tx=0x7f160002a3f0 comp rx=0 tx=0).stop 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 -- 172.21.15.60:0/1449468503 shutdown_connections 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 --2- 172.21.15.60:0/1449468503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1610109df0 0x7f1610110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 --2- 172.21.15.60:0/1449468503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16101094a0 0x7f16101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 --2- 172.21.15.60:0/1449468503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610103b60 0x7f1610103f70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 -- 172.21.15.60:0/1449468503 >> 172.21.15.60:0/1449468503 conn(0x7f161007b850 msgr2=0x7f161007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 -- 172.21.15.60:0/1449468503 shutdown_connections 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.826+0000 7f161692d640 1 -- 172.21.15.60:0/1449468503 wait complete. 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.827+0000 7f161692d640 1 Processor -- start 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.827+0000 7f161692d640 1 -- start start 2024-09-21T07:32:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.827+0000 7f161692d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1610103b60 0x7f161019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.827+0000 7f161692d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16101094a0 0x7f161019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.827+0000 7f161692d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 0x7f161019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f161692d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1610113ab0 con 0x7f1610109df0 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f161692d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1610113930 con 0x7f16101094a0 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f161692d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1610113c30 con 0x7f1610103b60 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 0x7f161019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f160ffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1610103b60 0x7f161019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 0x7f161019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33890/0 (socket says 172.21.15.60:33890) 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 -- 172.21.15.60:0/999142899 learned_addr learned my addr 172.21.15.60:0/999142899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1607fff640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16101094a0 0x7f161019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 -- 172.21.15.60:0/999142899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1610103b60 msgr2=0x7f161019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1610103b60 0x7f161019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:58.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 -- 172.21.15.60:0/999142899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16101094a0 msgr2=0x7f161019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16101094a0 0x7f161019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 -- 172.21.15.60:0/999142899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101a0310 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f1614eca640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 0x7f161019fca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f160800cce0 tx=0x7f160800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160800f450 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f160800faa0 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16101a0600 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.828+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608018b70 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.829+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101a6e20 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.829+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1610103f70 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.831+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1608018d10 con 0x7f1610109df0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.832+0000 7f160dffb640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f15fc0b65c0 0x7f15fc0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.832+0000 7f160ffff640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f15fc0b65c0 0x7f15fc0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:32:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.832+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f16080e7570 con 0x7f1610109df0 2024-09-21T07:32:58.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.833+0000 7f160ffff640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f15fc0b65c0 0x7f15fc0b8ad0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1600031440 tx=0x7f1600005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:32:58.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:58.835+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1608014030 con 0x7f1610109df0 2024-09-21T07:32:59.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.064+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f161019b590 con 0x7f1610109df0 2024-09-21T07:32:59.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.344+0000 7f160dffb640 1 -- 172.21.15.60:0/999142899 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f161019b590 con 0x7f1610109df0 2024-09-21T07:32:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f15fc0b65c0 msgr2=0x7f15fc0b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f15fc0b65c0 0x7f15fc0b8ad0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1600031440 tx=0x7f1600005e80 comp rx=0 tx=0).stop 2024-09-21T07:32:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 msgr2=0x7f161019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:32:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 0x7f161019fca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f160800cce0 tx=0x7f160800a620 comp rx=0 tx=0).stop 2024-09-21T07:32:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 shutdown_connections 2024-09-21T07:32:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f15fc0b65c0 0x7f15fc0b8ad0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1610109df0 0x7f161019fca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16101094a0 0x7f161019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 --2- 172.21.15.60:0/999142899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1610103b60 0x7f161019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:32:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.348+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 >> 172.21.15.60:0/999142899 conn(0x7f161007b850 msgr2=0x7f1610107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:32:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.349+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 shutdown_connections 2024-09-21T07:32:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:32:59.349+0000 7f161692d640 1 -- 172.21.15.60:0/999142899 wait complete. 2024-09-21T07:32:59.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:32:59 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/999142899' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:32:59.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:32:59 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/999142899' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:32:59.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:32:59 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/999142899' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:32:59.978 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-21T07:32:59.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T07:33:00.240 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:00.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:33:00 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: 2024-09-21T07:33:00.150+0000 7fc1ed393640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:33:00.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:00 smithi123 ceph-mon[34166]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T07:33:00.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:00 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/999142899' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:33:00.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:00 smithi123 ceph-mon[34166]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:33:00.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:00 smithi060 ceph-mon[31244]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T07:33:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:00 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/999142899' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:33:00.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:00 smithi060 ceph-mon[31244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:33:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.666+0000 7f76a4517640 1 -- 172.21.15.60:0/1458742007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c1094a0 msgr2=0x7f769c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.666+0000 7f76a4517640 1 --2- 172.21.15.60:0/1458742007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c1094a0 0x7f769c1098b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f768c009900 tx=0x7f768c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 -- 172.21.15.60:0/1458742007 shutdown_connections 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 --2- 172.21.15.60:0/1458742007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f769c109df0 0x7f769c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 --2- 172.21.15.60:0/1458742007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c1094a0 0x7f769c1098b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 --2- 172.21.15.60:0/1458742007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c103b60 0x7f769c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 -- 172.21.15.60:0/1458742007 >> 172.21.15.60:0/1458742007 conn(0x7f769c07b850 msgr2=0x7f769c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 -- 172.21.15.60:0/1458742007 shutdown_connections 2024-09-21T07:33:00.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 -- 172.21.15.60:0/1458742007 wait complete. 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 Processor -- start 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.667+0000 7f76a4517640 1 -- start start 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 0x7f769c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f769c1094a0 0x7f769c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c109df0 0x7f769c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f769c113ab0 con 0x7f769c103b60 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f769c113930 con 0x7f769c109df0 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f769c113c30 con 0x7f769c1094a0 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 0x7f769c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:00.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 0x7f769c19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33902/0 (socket says 172.21.15.60:33902) 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 -- 172.21.15.60:0/4148612955 learned_addr learned my addr 172.21.15.60:0/4148612955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a2ab4640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c109df0 0x7f769c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a1ab2640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f769c1094a0 0x7f769c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 -- 172.21.15.60:0/4148612955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f769c1094a0 msgr2=0x7f769c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f769c1094a0 0x7f769c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 -- 172.21.15.60:0/4148612955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c109df0 msgr2=0x7f769c19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c109df0 0x7f769c19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 -- 172.21.15.60:0/4148612955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c1a0430 con 0x7f769c103b60 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a22b3640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 0x7f769c19a580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f769800d950 tx=0x7f769800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698017070 con 0x7f769c103b60 2024-09-21T07:33:00.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7698009c30 con 0x7f769c103b60 2024-09-21T07:33:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.668+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c1a0720 con 0x7f769c103b60 2024-09-21T07:33:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.669+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769800f620 con 0x7f769c103b60 2024-09-21T07:33:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.669+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c1a6f40 con 0x7f769c103b60 2024-09-21T07:33:00.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.670+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c104de0 con 0x7f769c103b60 2024-09-21T07:33:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.672+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7698010460 con 0x7f769c103b60 2024-09-21T07:33:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.673+0000 7f76937fe640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f76880b6540 0x7f76880b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.673+0000 7f76a1ab2640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f76880b6540 0x7f76880b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.673+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f76980e6e20 con 0x7f769c103b60 2024-09-21T07:33:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.673+0000 7f76a1ab2640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f76880b6540 0x7f76880b8a50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f768c009230 tx=0x7f768c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:00.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.676+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76980ad760 con 0x7f769c103b60 2024-09-21T07:33:00.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:00 smithi187 ceph-mon[34367]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T07:33:00.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:00 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/999142899' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:33:00.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:00 smithi187 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:33:00.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:00.903+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f769c10bbc0 con 0x7f769c103b60 2024-09-21T07:33:01.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.354+0000 7f76937fe640 1 -- 172.21.15.60:0/4148612955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f7698009de0 con 0x7f769c103b60 2024-09-21T07:33:01.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f76880b6540 msgr2=0x7f76880b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:01.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f76880b6540 0x7f76880b8a50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f768c009230 tx=0x7f768c031400 comp rx=0 tx=0).stop 2024-09-21T07:33:01.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 msgr2=0x7f769c19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:01.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 0x7f769c19a580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f769800d950 tx=0x7f769800de10 comp rx=0 tx=0).stop 2024-09-21T07:33:01.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 shutdown_connections 2024-09-21T07:33:01.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f76880b6540 0x7f76880b8a50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:01.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f769c109df0 0x7f769c19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:01.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f769c1094a0 0x7f769c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:01.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 --2- 172.21.15.60:0/4148612955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f769c103b60 0x7f769c19a580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:01.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 >> 172.21.15.60:0/4148612955 conn(0x7f769c07b850 msgr2=0x7f769c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:01.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.356+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 shutdown_connections 2024-09-21T07:33:01.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:01.357+0000 7f76a4517640 1 -- 172.21.15.60:0/4148612955 wait complete. 2024-09-21T07:33:01.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:01 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4148612955' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T07:33:01.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:01 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4148612955' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T07:33:01.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:01 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4148612955' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T07:33:02.000 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T07:33:02.264 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:02.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:33:02.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:33:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4148612955' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T07:33:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:33:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:33:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T07:33:02.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:02 smithi060 ceph-mon[31244]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.715+0000 7f1b7a837640 1 -- 172.21.15.60:0/489401759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b741083a0 msgr2=0x7f1b741087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.715+0000 7f1b7a837640 1 --2- 172.21.15.60:0/489401759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b741083a0 0x7f1b741087b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009900 tx=0x7f1b5c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.715+0000 7f1b7a837640 1 -- 172.21.15.60:0/489401759 shutdown_connections 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.715+0000 7f1b7a837640 1 --2- 172.21.15.60:0/489401759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b74108cf0 0x7f1b7410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.715+0000 7f1b7a837640 1 --2- 172.21.15.60:0/489401759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b741083a0 0x7f1b741087b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.715+0000 7f1b7a837640 1 --2- 172.21.15.60:0/489401759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b74102a60 0x7f1b74102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.716+0000 7f1b7a837640 1 -- 172.21.15.60:0/489401759 >> 172.21.15.60:0/489401759 conn(0x7f1b74079730 msgr2=0x7f1b74079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:02.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.716+0000 7f1b7a837640 1 -- 172.21.15.60:0/489401759 shutdown_connections 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.716+0000 7f1b7a837640 1 -- 172.21.15.60:0/489401759 wait complete. 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.716+0000 7f1b7a837640 1 Processor -- start 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.716+0000 7f1b7a837640 1 -- start start 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b74102a60 0x7f1b7419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b741083a0 0x7f1b7419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 0x7f1b7419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74113a80 con 0x7f1b74108cf0 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74113900 con 0x7f1b741083a0 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74113c00 con 0x7f1b74102a60 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 0x7f1b7419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 0x7f1b7419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33920/0 (socket says 172.21.15.60:33920) 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 -- 172.21.15.60:0/2702348480 learned_addr learned my addr 172.21.15.60:0/2702348480 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:02.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b73fff640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b74102a60 0x7f1b7419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b6bfff640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b741083a0 0x7f1b7419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 -- 172.21.15.60:0/2702348480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b74102a60 msgr2=0x7f1b7419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b74102a60 0x7f1b7419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 -- 172.21.15.60:0/2702348480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b741083a0 msgr2=0x7f1b7419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b741083a0 0x7f1b7419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 -- 172.21.15.60:0/2702348480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741a0420 con 0x7f1b74108cf0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b6bfff640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b741083a0 0x7f1b7419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b78dd4640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 0x7f1b7419fcf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00eaa0 tx=0x7f1b6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00cdb0 con 0x7f1b74108cf0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b6c005020 con 0x7f1b74108cf0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.717+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b741a0710 con 0x7f1b74108cf0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.718+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0116d0 con 0x7f1b74108cf0 2024-09-21T07:33:02.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.718+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b741a6e70 con 0x7f1b74108cf0 2024-09-21T07:33:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.718+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74102e70 con 0x7f1b74108cf0 2024-09-21T07:33:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.720+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1b6c0051d0 con 0x7f1b74108cf0 2024-09-21T07:33:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.721+0000 7f1b71ffb640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1b600b6510 0x7f1b600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.721+0000 7f1b73fff640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1b600b6510 0x7f1b600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:02.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.721+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f1b6c0e76d0 con 0x7f1b74108cf0 2024-09-21T07:33:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.722+0000 7f1b73fff640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1b600b6510 0x7f1b600b8a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400bbe0 tx=0x7f1b6400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:02.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.724+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b6c016030 con 0x7f1b74108cf0 2024-09-21T07:33:02.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:33:02.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:33:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4148612955' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T07:33:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:33:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:33:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T07:33:02.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:02 smithi187 ceph-mon[34367]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T07:33:02.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:33:02.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:33:02.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4148612955' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T07:33:02.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:33:02.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:33:02.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T07:33:02.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:02 smithi123 ceph-mon[34166]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T07:33:02.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:02.949+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f1b7402e640 con 0x7f1b74108cf0 2024-09-21T07:33:03.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.370+0000 7f1b71ffb640 1 -- 172.21.15.60:0/2702348480 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f1b6c0ae0b0 con 0x7f1b74108cf0 2024-09-21T07:33:03.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1b600b6510 msgr2=0x7f1b600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:03.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1b600b6510 0x7f1b600b8a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400bbe0 tx=0x7f1b6400b390 comp rx=0 tx=0).stop 2024-09-21T07:33:03.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 msgr2=0x7f1b7419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:03.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 0x7f1b7419fcf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00eaa0 tx=0x7f1b6c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:33:03.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 shutdown_connections 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1b600b6510 0x7f1b600b8a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b74108cf0 0x7f1b7419fcf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b741083a0 0x7f1b7419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 --2- 172.21.15.60:0/2702348480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b74102a60 0x7f1b7419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 >> 172.21.15.60:0/2702348480 conn(0x7f1b74079730 msgr2=0x7f1b741044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 shutdown_connections 2024-09-21T07:33:03.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:03.373+0000 7f1b7a837640 1 -- 172.21.15.60:0/2702348480 wait complete. 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] up:active 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: Cluster is now healthy 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T07:33:03.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T07:33:03.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:03 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2702348480' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:33:03.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] up:active 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: Cluster is now healthy 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T07:33:03.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:03 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2702348480' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] up:active 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: Cluster is now healthy 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T07:33:03.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:03 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2702348480' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:33:04.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T07:33:04.291 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:04.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:04 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2702348480' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:33:04.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:04 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] up:active 2024-09-21T07:33:04.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:04 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T07:33:04.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:04 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:33:04.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:04 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2702348480' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:33:04.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:04 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] up:active 2024-09-21T07:33:04.811 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:04 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T07:33:04.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:04 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:33:04.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:04 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2702348480' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:33:04.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:04 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] up:active 2024-09-21T07:33:04.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:04 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T07:33:04.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:04 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 -- 172.21.15.60:0/910531202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84075730 msgr2=0x7f0a84075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/910531202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84075730 0x7f0a84075b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009ca0 tx=0x7f0a7402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 -- 172.21.15.60:0/910531202 shutdown_connections 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/910531202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a841101a0 0x7f0a841125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/910531202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 0x7f0a8410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/910531202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84075730 0x7f0a84075b40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 -- 172.21.15.60:0/910531202 >> 172.21.15.60:0/910531202 conn(0x7f0a8407b910 msgr2=0x7f0a8407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 -- 172.21.15.60:0/910531202 shutdown_connections 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.908+0000 7f0a8ba87640 1 -- 172.21.15.60:0/910531202 wait complete. 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 Processor -- start 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 -- start start 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a84075730 0x7f0a8419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 0x7f0a8419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 0x7f0a841a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84115cb0 con 0x7f0a841101a0 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84115b30 con 0x7f0a84075730 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8ba87640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84115e30 con 0x7f0a84076080 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8a024640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 0x7f0a841a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8a024640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 0x7f0a841a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33932/0 (socket says 172.21.15.60:33932) 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.909+0000 7f0a8a024640 1 -- 172.21.15.60:0/977948990 learned_addr learned my addr 172.21.15.60:0/977948990 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a89022640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 0x7f0a8419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a89823640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a84075730 0x7f0a8419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8a024640 1 -- 172.21.15.60:0/977948990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 msgr2=0x7f0a8419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8a024640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 0x7f0a8419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8a024640 1 -- 172.21.15.60:0/977948990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a84075730 msgr2=0x7f0a8419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8a024640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a84075730 0x7f0a8419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8a024640 1 -- 172.21.15.60:0/977948990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a841a2610 con 0x7f0a841101a0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a89022640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 0x7f0a8419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a89823640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a84075730 0x7f0a8419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8a024640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 0x7f0a841a1ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00d950 tx=0x7f0a7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c017030 con 0x7f0a841101a0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a841a2900 con 0x7f0a841101a0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a7c004020 con 0x7f0a841101a0 2024-09-21T07:33:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c003b50 con 0x7f0a841101a0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.910+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a841a9060 con 0x7f0a841101a0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.911+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a84075b40 con 0x7f0a841101a0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.913+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0a7c01a070 con 0x7f0a841101a0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.914+0000 7f0a82ffd640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0a6c0b6510 0x7f0a6c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.914+0000 7f0a89823640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0a6c0b6510 0x7f0a6c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.914+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f0a7c0e6d50 con 0x7f0a841101a0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.915+0000 7f0a89823640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0a6c0b6510 0x7f0a6c0b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a74006010 tx=0x7f0a74000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:04.917+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a7c021070 con 0x7f0a841101a0 2024-09-21T07:33:05.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.145+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0a841a9360 con 0x7f0a841101a0 2024-09-21T07:33:05.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.377+0000 7f0a82ffd640 1 -- 172.21.15.60:0/977948990 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f0a7c0ad730 con 0x7f0a841101a0 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0a6c0b6510 msgr2=0x7f0a6c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0a6c0b6510 0x7f0a6c0b8a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a74006010 tx=0x7f0a74000f40 comp rx=0 tx=0).stop 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 msgr2=0x7f0a841a1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 0x7f0a841a1ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00d950 tx=0x7f0a7c00de10 comp rx=0 tx=0).stop 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 shutdown_connections 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f0a6c0b6510 0x7f0a6c0b8a20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841101a0 0x7f0a841a1ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:05.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a84076080 0x7f0a8419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 --2- 172.21.15.60:0/977948990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a84075730 0x7f0a8419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 >> 172.21.15.60:0/977948990 conn(0x7f0a8407b910 msgr2=0x7f0a841017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 shutdown_connections 2024-09-21T07:33:05.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:05.380+0000 7f0a8ba87640 1 -- 172.21.15.60:0/977948990 wait complete. 2024-09-21T07:33:05.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:05 smithi060 ceph-mon[31244]: pgmap v290: 97 pgs: 97 active+clean; 580 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-09-21T07:33:05.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:05 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/977948990' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:33:05.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:05 smithi123 ceph-mon[34166]: pgmap v290: 97 pgs: 97 active+clean; 580 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-09-21T07:33:05.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:05 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/977948990' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:33:05.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:33:05 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: 2024-09-21T07:33:05.150+0000 7fc1ed393640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T07:33:05.599 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 07:33:05 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: 2024-09-21T07:33:05.150+0000 7fc1ed393640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T07:33:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:05 smithi187 ceph-mon[34367]: pgmap v290: 97 pgs: 97 active+clean; 580 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 8 op/s 2024-09-21T07:33:05.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:05 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/977948990' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:33:05.992 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T07:33:05.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T07:33:06.254 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:06.647 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/977948990' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:33:06.648 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:33:06.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 -- 172.21.15.60:0/1417038807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 msgr2=0x7f1894103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:06.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 --2- 172.21.15.60:0/1417038807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f1894103f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1884009900 tx=0x7f188402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:06.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 -- 172.21.15.60:0/1417038807 shutdown_connections 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 --2- 172.21.15.60:0/1417038807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1894109e10 0x7f1894110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 --2- 172.21.15.60:0/1417038807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18941094c0 0x7f18941098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 --2- 172.21.15.60:0/1417038807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f1894103f90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 -- 172.21.15.60:0/1417038807 >> 172.21.15.60:0/1417038807 conn(0x7f18940ff5d0 msgr2=0x7f1894101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 -- 172.21.15.60:0/1417038807 shutdown_connections 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.741+0000 7f1899eda640 1 -- 172.21.15.60:0/1417038807 wait complete. 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 Processor -- start 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 -- start start 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f189419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18941094c0 0x7f189419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1894109e10 0x7f189419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:06.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1894113b10 con 0x7f1894103b80 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1894113990 con 0x7f18941094c0 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1899eda640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1894113c90 con 0x7f1894109e10 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f18937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f189419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f18937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f189419a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55716/0 (socket says 172.21.15.60:55716) 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f18937fe640 1 -- 172.21.15.60:0/2226646884 learned_addr learned my addr 172.21.15.60:0/2226646884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1892ffd640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18941094c0 0x7f189419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.742+0000 7f1893fff640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1894109e10 0x7f189419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f18937fe640 1 -- 172.21.15.60:0/2226646884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1894109e10 msgr2=0x7f189419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f18937fe640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1894109e10 0x7f189419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f18937fe640 1 -- 172.21.15.60:0/2226646884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18941094c0 msgr2=0x7f189419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f18937fe640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18941094c0 0x7f189419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f18937fe640 1 -- 172.21.15.60:0/2226646884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18941a03f0 con 0x7f1894103b80 2024-09-21T07:33:06.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f18937fe640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f189419a540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1884006010 tx=0x7f18840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:06.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188403f030 con 0x7f1894103b80 2024-09-21T07:33:06.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18941a0680 con 0x7f1894103b80 2024-09-21T07:33:06.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1884003800 con 0x7f1894103b80 2024-09-21T07:33:06.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884035070 con 0x7f1894103b80 2024-09-21T07:33:06.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.743+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941a6f00 con 0x7f1894103b80 2024-09-21T07:33:06.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.744+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1894104e00 con 0x7f1894103b80 2024-09-21T07:33:06.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.746+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f18840039b0 con 0x7f1894103b80 2024-09-21T07:33:06.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.747+0000 7f1890ff9640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f187c0b6540 0x7f187c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:06.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.747+0000 7f1892ffd640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f187c0b6540 0x7f187c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:06.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.747+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f1884107d90 con 0x7f1894103b80 2024-09-21T07:33:06.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.748+0000 7f1892ffd640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f187c0b6540 0x7f187c0b8a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1894108fc0 tx=0x7f1888008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:06.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.751+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18840ce770 con 0x7f1894103b80 2024-09-21T07:33:06.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:06 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/977948990' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:33:06.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:06 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:33:06.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:06 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/977948990' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:33:06.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:06 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:33:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.967+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1894063800 con 0x7f187c0b6540 2024-09-21T07:33:07.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:06.997+0000 7f1890ff9640 1 -- 172.21.15.60:0/2226646884 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1894063800 con 0x7f187c0b6540 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f187c0b6540 msgr2=0x7f187c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f187c0b6540 0x7f187c0b8a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1894108fc0 tx=0x7f1888008040 comp rx=0 tx=0).stop 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 msgr2=0x7f189419a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f189419a540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1884006010 tx=0x7f18840042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 shutdown_connections 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f187c0b6540 0x7f187c0b8a50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1894109e10 0x7f189419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18941094c0 0x7f189419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:07.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 --2- 172.21.15.60:0/2226646884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894103b80 0x7f189419a540 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 >> 172.21.15.60:0/2226646884 conn(0x7f18940ff5d0 msgr2=0x7f18941019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 shutdown_connections 2024-09-21T07:33:07.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:07.000+0000 7f1899eda640 1 -- 172.21.15.60:0/2226646884 wait complete. 2024-09-21T07:33:07.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:33:06.973+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:33:07.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:33:06.973+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:33:07.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:33:06.973+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:33:07.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:33:06.973+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:33:07.372 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:33:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:33:06.973+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:33:07.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T07:33:07.653 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:07 smithi060 ceph-mon[31244]: pgmap v291: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-21T07:33:07.653 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:07 smithi060 ceph-mon[31244]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:07.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:07 smithi187 ceph-mon[34367]: pgmap v291: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-21T07:33:07.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:07 smithi187 ceph-mon[34367]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:07.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:07 smithi123 ceph-mon[34166]: pgmap v291: 97 pgs: 97 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-09-21T07:33:07.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:07 smithi123 ceph-mon[34166]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 -- 172.21.15.60:0/2663433344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 msgr2=0x7fec80103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 --2- 172.21.15.60:0/2663433344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec80103f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009900 tx=0x7fec7c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 -- 172.21.15.60:0/2663433344 shutdown_connections 2024-09-21T07:33:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 --2- 172.21.15.60:0/2663433344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec80109e00 0x7fec80110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 --2- 172.21.15.60:0/2663433344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 0x7fec801098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 --2- 172.21.15.60:0/2663433344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec80103f80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 -- 172.21.15.60:0/2663433344 >> 172.21.15.60:0/2663433344 conn(0x7fec800ff5e0 msgr2=0x7fec80101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:08.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 -- 172.21.15.60:0/2663433344 shutdown_connections 2024-09-21T07:33:08.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.376+0000 7fec8827f640 1 -- 172.21.15.60:0/2663433344 wait complete. 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 Processor -- start 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 -- start start 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec8019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 0x7fec8019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec80109e00 0x7fec8019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec80113ac0 con 0x7fec80103b70 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec80113940 con 0x7fec801094b0 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8827f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec80113c40 con 0x7fec80109e00 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8601b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec8019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8601b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec8019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55746/0 (socket says 172.21.15.60:55746) 2024-09-21T07:33:08.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.377+0000 7fec8601b640 1 -- 172.21.15.60:0/33701496 learned_addr learned my addr 172.21.15.60:0/33701496 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8681c640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec80109e00 0x7fec8019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8581a640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 0x7fec8019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8601b640 1 -- 172.21.15.60:0/33701496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec80109e00 msgr2=0x7fec8019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8601b640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec80109e00 0x7fec8019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8601b640 1 -- 172.21.15.60:0/33701496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 msgr2=0x7fec8019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8601b640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 0x7fec8019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8601b640 1 -- 172.21.15.60:0/33701496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec801a0420 con 0x7fec80103b70 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8581a640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 0x7fec8019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8601b640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec8019a4b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec7c005940 tx=0x7fec7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c03f030 con 0x7fec80103b70 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec801a06b0 con 0x7fec80103b70 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec7c003cb0 con 0x7fec80103b70 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c035070 con 0x7fec80103b70 2024-09-21T07:33:08.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.378+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec801a6e70 con 0x7fec80103b70 2024-09-21T07:33:08.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.379+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec80104df0 con 0x7fec80103b70 2024-09-21T07:33:08.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.382+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fec7c042030 con 0x7fec80103b70 2024-09-21T07:33:08.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.382+0000 7fec777fe640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fec6c0b6510 0x7fec6c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:08.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.383+0000 7fec8581a640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fec6c0b6510 0x7fec6c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:08.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.383+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fec7c107ca0 con 0x7fec80103b70 2024-09-21T07:33:08.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.383+0000 7fec8581a640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fec6c0b6510 0x7fec6c0b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fec80108fd0 tx=0x7fec70005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:08.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.386+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec7c0ce680 con 0x7fec80103b70 2024-09-21T07:33:08.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.601+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fec8010bc30 con 0x7fec6c0b6510 2024-09-21T07:33:08.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.632+0000 7fec777fe640 1 -- 172.21.15.60:0/33701496 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fec8010bc30 con 0x7fec6c0b6510 2024-09-21T07:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fec6c0b6510 msgr2=0x7fec6c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fec6c0b6510 0x7fec6c0b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fec80108fd0 tx=0x7fec70005e50 comp rx=0 tx=0).stop 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 msgr2=0x7fec8019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec8019a4b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec7c005940 tx=0x7fec7c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 shutdown_connections 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fec6c0b6510 0x7fec6c0b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec80109e00 0x7fec8019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec801094b0 0x7fec8019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 --2- 172.21.15.60:0/33701496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec80103b70 0x7fec8019a4b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 >> 172.21.15.60:0/33701496 conn(0x7fec800ff5e0 msgr2=0x7fec80101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 shutdown_connections 2024-09-21T07:33:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:08.634+0000 7fec8827f640 1 -- 172.21.15.60:0/33701496 wait complete. 2024-09-21T07:33:09.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T07:33:09.604 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:09.921 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:09 smithi060 ceph-mon[31244]: pgmap v292: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-21T07:33:09.921 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:09 smithi060 ceph-mon[31244]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:09 smithi187 ceph-mon[34367]: pgmap v292: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-21T07:33:10.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:09 smithi187 ceph-mon[34367]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:09 smithi123 ceph-mon[34166]: pgmap v292: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.9 KiB/s wr, 13 op/s 2024-09-21T07:33:10.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:09 smithi123 ceph-mon[34166]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:10.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 -- 172.21.15.60:0/725874739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0103b80 msgr2=0x7fc7e0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:10.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/725874739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0103b80 0x7fc7e0103f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009900 tx=0x7fc7d002a410 comp rx=0 tx=0).stop 2024-09-21T07:33:10.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 -- 172.21.15.60:0/725874739 shutdown_connections 2024-09-21T07:33:10.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/725874739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e0109e10 0x7fc7e0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/725874739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e01094c0 0x7fc7e01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/725874739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0103b80 0x7fc7e0103f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 -- 172.21.15.60:0/725874739 >> 172.21.15.60:0/725874739 conn(0x7fc7e00ff610 msgr2=0x7fc7e0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 -- 172.21.15.60:0/725874739 shutdown_connections 2024-09-21T07:33:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.133+0000 7fc7e5e21640 1 -- 172.21.15.60:0/725874739 wait complete. 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 Processor -- start 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 -- start start 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0103b80 0x7fc7e019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e01094c0 0x7fc7e019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 0x7fc7e019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e0113b10 con 0x7fc7e0109e10 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e0113990 con 0x7fc7e01094c0 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7e5e21640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e0113c90 con 0x7fc7e0103b80 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 0x7fc7e019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.134+0000 7fc7dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 0x7fc7e019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55766/0 (socket says 172.21.15.60:55766) 2024-09-21T07:33:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 -- 172.21.15.60:0/3176724091 learned_addr learned my addr 172.21.15.60:0/3176724091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7df7fe640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0103b80 0x7fc7e019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7deffd640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e01094c0 0x7fc7e019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 -- 172.21.15.60:0/3176724091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0103b80 msgr2=0x7fc7e019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0103b80 0x7fc7e019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 -- 172.21.15.60:0/3176724091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e01094c0 msgr2=0x7fc7e019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e01094c0 0x7fc7e019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 -- 172.21.15.60:0/3176724091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e01a0430 con 0x7fc7e0109e10 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7deffd640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e01094c0 0x7fc7e019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dffff640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 0x7fc7e019fdc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800cce0 tx=0x7fc7d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800f450 con 0x7fc7e0109e10 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d800faa0 con 0x7fc7e0109e10 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e01a0720 con 0x7fc7e0109e10 2024-09-21T07:33:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8018b70 con 0x7fc7e0109e10 2024-09-21T07:33:10.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.135+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e01a0c10 con 0x7fc7e0109e10 2024-09-21T07:33:10.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.136+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e0104e00 con 0x7fc7e0109e10 2024-09-21T07:33:10.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.138+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc7d8018d10 con 0x7fc7e0109e10 2024-09-21T07:33:10.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.139+0000 7fc7dcff9640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc7c80b65d0 0x7fc7c80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:10.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.139+0000 7fc7df7fe640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc7c80b65d0 0x7fc7c80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:10.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.139+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fc7d80e77c0 con 0x7fc7e0109e10 2024-09-21T07:33:10.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.139+0000 7fc7df7fe640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc7c80b65d0 0x7fc7c80b8ae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0031440 tx=0x7fc7d0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:10.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.142+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7e01a0c10 con 0x7fc7e0109e10 2024-09-21T07:33:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.357+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc7e0063800 con 0x7fc7c80b65d0 2024-09-21T07:33:10.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.364+0000 7fc7dcff9640 1 -- 172.21.15.60:0/3176724091 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc7e0063800 con 0x7fc7c80b65d0 2024-09-21T07:33:10.366 INFO:teuthology.orchestra.run.smithi060.stdout:/volumes/qa/sv_0/93cc72d1-6568-4522-9491-0c29b0fd3133 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc7c80b65d0 msgr2=0x7fc7c80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc7c80b65d0 0x7fc7c80b8ae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0031440 tx=0x7fc7d0005e80 comp rx=0 tx=0).stop 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 msgr2=0x7fc7e019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 0x7fc7e019fdc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7d800cce0 tx=0x7fc7d800a620 comp rx=0 tx=0).stop 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 shutdown_connections 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc7c80b65d0 0x7fc7c80b8ae0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e0109e10 0x7fc7e019fdc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7e01094c0 0x7fc7e019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 --2- 172.21.15.60:0/3176724091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7e0103b80 0x7fc7e019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 >> 172.21.15.60:0/3176724091 conn(0x7fc7e00ff610 msgr2=0x7fc7e0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 shutdown_connections 2024-09-21T07:33:10.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:10.366+0000 7fc7e5e21640 1 -- 172.21.15.60:0/3176724091 wait complete. 2024-09-21T07:33:10.944 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:10 smithi060 ceph-mon[31244]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:33:10.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T07:33:11.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:10 smithi187 ceph-mon[34367]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:33:11.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:10 smithi123 ceph-mon[34166]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:33:11.231 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.738+0000 7fec0b941640 1 -- 172.21.15.60:0/137641742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041094a0 msgr2=0x7fec041098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.738+0000 7fec0b941640 1 --2- 172.21.15.60:0/137641742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041094a0 0x7fec041098b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7febf4009900 tx=0x7febf402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 -- 172.21.15.60:0/137641742 shutdown_connections 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 --2- 172.21.15.60:0/137641742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04109df0 0x7fec04110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 --2- 172.21.15.60:0/137641742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041094a0 0x7fec041098b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 --2- 172.21.15.60:0/137641742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec04103b60 0x7fec04103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 -- 172.21.15.60:0/137641742 >> 172.21.15.60:0/137641742 conn(0x7fec0407b850 msgr2=0x7fec0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 -- 172.21.15.60:0/137641742 shutdown_connections 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 -- 172.21.15.60:0/137641742 wait complete. 2024-09-21T07:33:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 Processor -- start 2024-09-21T07:33:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.739+0000 7fec0b941640 1 -- start start 2024-09-21T07:33:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec0b941640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04103b60 0x7fec0419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec0b941640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec041094a0 0x7fec0419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec0b941640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 0x7fec0419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec0b941640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec04113ab0 con 0x7fec04109df0 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec0b941640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec04113930 con 0x7fec04103b60 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec0b941640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fec04113c30 con 0x7fec041094a0 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 0x7fec0419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 0x7fec0419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55794/0 (socket says 172.21.15.60:55794) 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 -- 172.21.15.60:0/71659440 learned_addr learned my addr 172.21.15.60:0/71659440 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec096dd640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04103b60 0x7fec0419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec08edc640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec041094a0 0x7fec0419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 -- 172.21.15.60:0/71659440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec041094a0 msgr2=0x7fec0419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec041094a0 0x7fec0419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 -- 172.21.15.60:0/71659440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04103b60 msgr2=0x7fec0419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04103b60 0x7fec0419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 -- 172.21.15.60:0/71659440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec041a0410 con 0x7fec04109df0 2024-09-21T07:33:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec08edc640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec041094a0 0x7fec0419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec096dd640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04103b60 0x7fec0419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.740+0000 7fec09ede640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 0x7fec0419fce0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7febfc00eaa0 tx=0x7febfc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.741+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc00cdb0 con 0x7fec04109df0 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.741+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec041a0700 con 0x7fec04109df0 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.741+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc005020 con 0x7fec04109df0 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.741+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc0116d0 con 0x7fec04109df0 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.741+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041a6e60 con 0x7fec04109df0 2024-09-21T07:33:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.742+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec04103f70 con 0x7fec04109df0 2024-09-21T07:33:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.743+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7febfc0051d0 con 0x7fec04109df0 2024-09-21T07:33:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.744+0000 7febfa7fc640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7febf00b65a0 0x7febf00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.744+0000 7fec096dd640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7febf00b65a0 0x7febf00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.744+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7febfc0e7a60 con 0x7fec04109df0 2024-09-21T07:33:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.745+0000 7fec096dd640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7febf00b65a0 0x7febf00b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec000058c0 tx=0x7fec00005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:11.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.747+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7febfc016030 con 0x7fec04109df0 2024-09-21T07:33:11.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.966+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fec04063800 con 0x7febf00b65a0 2024-09-21T07:33:11.969 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:11 smithi060 ceph-mon[31244]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:11.969 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:11 smithi060 ceph-mon[31244]: pgmap v293: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T07:33:11.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.996+0000 7febfa7fc640 1 -- 172.21.15.60:0/71659440 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fec04063800 con 0x7febf00b65a0 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7febf00b65a0 msgr2=0x7febf00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7febf00b65a0 0x7febf00b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec000058c0 tx=0x7fec00005850 comp rx=0 tx=0).stop 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 msgr2=0x7fec0419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 0x7fec0419fce0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7febfc00eaa0 tx=0x7febfc00ef60 comp rx=0 tx=0).stop 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 shutdown_connections 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7febf00b65a0 0x7febf00b8ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04109df0 0x7fec0419fce0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec041094a0 0x7fec0419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 --2- 172.21.15.60:0/71659440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec04103b60 0x7fec0419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 >> 172.21.15.60:0/71659440 conn(0x7fec0407b850 msgr2=0x7fec04107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 shutdown_connections 2024-09-21T07:33:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:11.998+0000 7fec0b941640 1 -- 172.21.15.60:0/71659440 wait complete. 2024-09-21T07:33:12.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:11 smithi187 ceph-mon[34367]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:12.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:11 smithi187 ceph-mon[34367]: pgmap v293: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T07:33:12.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:11 smithi123 ceph-mon[34166]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:12.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:11 smithi123 ceph-mon[34166]: pgmap v293: 97 pgs: 97 active+clean; 582 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T07:33:12.614 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T07:33:12.872 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:12.994 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:12 smithi060 ceph-mon[31244]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:13.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:12 smithi187 ceph-mon[34367]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:13.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:12 smithi123 ceph-mon[34166]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.341+0000 7f27f7161640 1 -- 172.21.15.60:0/128388952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 msgr2=0x7f27f0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.341+0000 7f27f7161640 1 --2- 172.21.15.60:0/128388952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f0102ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009900 tx=0x7f27d802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 -- 172.21.15.60:0/128388952 shutdown_connections 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 --2- 172.21.15.60:0/128388952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27f0108d20 0x7f27f010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 --2- 172.21.15.60:0/128388952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27f01083d0 0x7f27f01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 --2- 172.21.15.60:0/128388952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f0102ea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 -- 172.21.15.60:0/128388952 >> 172.21.15.60:0/128388952 conn(0x7f27f0079750 msgr2=0x7f27f0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 -- 172.21.15.60:0/128388952 shutdown_connections 2024-09-21T07:33:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 -- 172.21.15.60:0/128388952 wait complete. 2024-09-21T07:33:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 Processor -- start 2024-09-21T07:33:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.342+0000 7f27f7161640 1 -- start start 2024-09-21T07:33:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f7161640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f7161640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27f01083d0 0x7f27f019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f7161640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27f0108d20 0x7f27f019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f7161640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0112990 con 0x7f27f0102a90 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f7161640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0112810 con 0x7f27f0108d20 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f7161640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0112b10 con 0x7f27f01083d0 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55816/0 (socket says 172.21.15.60:55816) 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 -- 172.21.15.60:0/4146859670 learned_addr learned my addr 172.21.15.60:0/4146859670 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27effff640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27f01083d0 0x7f27f019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f56fe640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27f0108d20 0x7f27f019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 -- 172.21.15.60:0/4146859670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27f01083d0 msgr2=0x7f27f019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27f01083d0 0x7f27f019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 -- 172.21.15.60:0/4146859670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27f0108d20 msgr2=0x7f27f019bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27f0108d20 0x7f27f019bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 -- 172.21.15.60:0/4146859670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f01a64c0 con 0x7f27f0102a90 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.343+0000 7f27f4efd640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f019b2c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005940 tx=0x7f27d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.344+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d803f030 con 0x7f27f0102a90 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.344+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d8003cb0 con 0x7f27f0102a90 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.344+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8035070 con 0x7f27f0102a90 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.344+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f01a6750 con 0x7f27f0102a90 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.344+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f01a6be0 con 0x7f27f0102a90 2024-09-21T07:33:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.345+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f0103d10 con 0x7f27f0102a90 2024-09-21T07:33:13.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.347+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f27d8042030 con 0x7f27f0102a90 2024-09-21T07:33:13.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.348+0000 7f27edffb640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f27dc0b65d0 0x7f27dc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:13.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.348+0000 7f27effff640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f27dc0b65d0 0x7f27dc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:13.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.348+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f27d8107b40 con 0x7f27f0102a90 2024-09-21T07:33:13.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.349+0000 7f27effff640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f27dc0b65d0 0x7f27dc0b8ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27f0079db0 tx=0x7f27e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:13.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.351+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27d80d2700 con 0x7f27f0102a90 2024-09-21T07:33:13.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.568+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f27f0063800 con 0x7f27dc0b65d0 2024-09-21T07:33:13.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.574+0000 7f27edffb640 1 -- 172.21.15.60:0/4146859670 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f27f0063800 con 0x7f27dc0b65d0 2024-09-21T07:33:13.576 INFO:teuthology.orchestra.run.smithi060.stdout:/volumes/qa/sv_1/61e58c50-89d3-4ee1-9aba-6d35b9d65b4d 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f27dc0b65d0 msgr2=0x7f27dc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f27dc0b65d0 0x7f27dc0b8ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f27f0079db0 tx=0x7f27e000b390 comp rx=0 tx=0).stop 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 msgr2=0x7f27f019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f019b2c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005940 tx=0x7f27d80042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 shutdown_connections 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f27dc0b65d0 0x7f27dc0b8ae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27f0108d20 0x7f27f019bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27f01083d0 0x7f27f019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 --2- 172.21.15.60:0/4146859670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27f0102a90 0x7f27f019b2c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 >> 172.21.15.60:0/4146859670 conn(0x7f27f0079750 msgr2=0x7f27f0101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 shutdown_connections 2024-09-21T07:33:13.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:13.576+0000 7f27f7161640 1 -- 172.21.15.60:0/4146859670 wait complete. 2024-09-21T07:33:13.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:13 smithi060 ceph-mon[31244]: pgmap v294: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-21T07:33:14.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:13 smithi187 ceph-mon[34367]: pgmap v294: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-21T07:33:14.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:13 smithi123 ceph-mon[34166]: pgmap v294: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-21T07:33:14.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:33:14.467 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:14.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:14 smithi060 ceph-mon[31244]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 -- 172.21.15.60:0/1339174663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4102a60 msgr2=0x7fd7f4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/1339174663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4102a60 0x7fd7f4102e70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009900 tx=0x7fd7e402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 -- 172.21.15.60:0/1339174663 shutdown_connections 2024-09-21T07:33:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/1339174663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4108cf0 0x7fd7f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/1339174663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f41083a0 0x7fd7f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/1339174663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4102a60 0x7fd7f4102e70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 -- 172.21.15.60:0/1339174663 >> 172.21.15.60:0/1339174663 conn(0x7fd7f4079730 msgr2=0x7fd7f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 -- 172.21.15.60:0/1339174663 shutdown_connections 2024-09-21T07:33:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.929+0000 7fd7fad0f640 1 -- 172.21.15.60:0/1339174663 wait complete. 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 Processor -- start 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 -- start start 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4102a60 0x7fd7f419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f41083a0 0x7fd7f419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 0x7fd7f419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4112960 con 0x7fd7f4108cf0 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41127e0 con 0x7fd7f4102a60 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7fad0f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4112ae0 con 0x7fd7f41083a0 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7f92ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 0x7fd7f419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7f92ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 0x7fd7f419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55840/0 (socket says 172.21.15.60:55840) 2024-09-21T07:33:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.930+0000 7fd7f92ac640 1 -- 172.21.15.60:0/858738991 learned_addr learned my addr 172.21.15.60:0/858738991 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f3fff640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f41083a0 0x7fd7f419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f8aab640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4102a60 0x7fd7f419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f92ac640 1 -- 172.21.15.60:0/858738991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f41083a0 msgr2=0x7fd7f419b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f92ac640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f41083a0 0x7fd7f419b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f92ac640 1 -- 172.21.15.60:0/858738991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4102a60 msgr2=0x7fd7f419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f92ac640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4102a60 0x7fd7f419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f92ac640 1 -- 172.21.15.60:0/858738991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f41a64e0 con 0x7fd7f4108cf0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f8aab640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4102a60 0x7fd7f419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f92ac640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 0x7fd7f419bd30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00cce0 tx=0x7fd7ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00f450 con 0x7fd7f4108cf0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7ec00faa0 con 0x7fd7f4108cf0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f41a67d0 con 0x7fd7f4108cf0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.931+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec018b70 con 0x7fd7f4108cf0 2024-09-21T07:33:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.932+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f41a6d10 con 0x7fd7f4108cf0 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.933+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f4102e70 con 0x7fd7f4108cf0 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.934+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd7ec018d10 con 0x7fd7f4108cf0 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.935+0000 7fd7f1ffb640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd7e00b6620 0x7fd7e00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.935+0000 7fd7f8aab640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd7e00b6620 0x7fd7e00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:14.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.935+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fd7ec0e7820 con 0x7fd7f4108cf0 2024-09-21T07:33:14.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.935+0000 7fd7f8aab640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd7e00b6620 0x7fd7e00b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4000c00 tx=0x7fd7e4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:14.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:14.939+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7ec014030 con 0x7fd7f4108cf0 2024-09-21T07:33:15.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:14 smithi187 ceph-mon[34367]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:15.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:14 smithi123 ceph-mon[34166]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:33:15.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.168+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7f410ab20 con 0x7fd7f4108cf0 2024-09-21T07:33:15.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.169+0000 7fd7f1ffb640 1 -- 172.21.15.60:0/858738991 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fd7ec0ae000 con 0x7fd7f4108cf0 2024-09-21T07:33:15.172 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:15.172 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T07:33:05:373246+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:33:05.146717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24613,24623,24653]},"id":1}]} 2024-09-21T07:33:15.172 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd7e00b6620 msgr2=0x7fd7e00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd7e00b6620 0x7fd7e00b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4000c00 tx=0x7fd7e4009680 comp rx=0 tx=0).stop 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 msgr2=0x7fd7f419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 0x7fd7f419bd30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00cce0 tx=0x7fd7ec00a620 comp rx=0 tx=0).stop 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 shutdown_connections 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd7e00b6620 0x7fd7e00b8b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7f4108cf0 0x7fd7f419bd30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f41083a0 0x7fd7f419b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 --2- 172.21.15.60:0/858738991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7f4102a60 0x7fd7f419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 >> 172.21.15.60:0/858738991 conn(0x7fd7f4079730 msgr2=0x7fd7f4101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 shutdown_connections 2024-09-21T07:33:15.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:15.172+0000 7fd7fad0f640 1 -- 172.21.15.60:0/858738991 wait complete. 2024-09-21T07:33:15.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:15 smithi060 ceph-mon[31244]: pgmap v295: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T07:33:15.778 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:15 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/858738991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:33:15.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:33:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:15 smithi187 ceph-mon[34367]: pgmap v295: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T07:33:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:15 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/858738991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:33:16.063 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:16.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:15 smithi123 ceph-mon[34166]: pgmap v295: 97 pgs: 97 active+clean; 609 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T07:33:16.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:15 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/858738991' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 -- 172.21.15.60:0/1961032387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8075730 msgr2=0x7f71c8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/1961032387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8075730 0x7f71c8075b40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009900 tx=0x7f71c002a410 comp rx=0 tx=0).stop 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 -- 172.21.15.60:0/1961032387 shutdown_connections 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/1961032387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71c81101a0 0x7f71c81125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/1961032387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c8076080 0x7f71c810fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/1961032387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8075730 0x7f71c8075b40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 -- 172.21.15.60:0/1961032387 >> 172.21.15.60:0/1961032387 conn(0x7f71c807b910 msgr2=0x7f71c807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 -- 172.21.15.60:0/1961032387 shutdown_connections 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.531+0000 7f71ceb3d640 1 -- 172.21.15.60:0/1961032387 wait complete. 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 Processor -- start 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 -- start start 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c8075730 0x7f71c819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 0x7f71c819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71c81101a0 0x7f71c81a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8115c90 con 0x7f71c8076080 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8115b10 con 0x7f71c81101a0 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71ceb3d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f71c8115e10 con 0x7f71c8075730 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 0x7f71c819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 0x7f71c819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37602/0 (socket says 172.21.15.60:37602) 2024-09-21T07:33:16.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 -- 172.21.15.60:0/220803086 learned_addr learned my addr 172.21.15.60:0/220803086 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71cc8d9640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c8075730 0x7f71c819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71cd0da640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71c81101a0 0x7f71c81a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 -- 172.21.15.60:0/220803086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c8075730 msgr2=0x7f71c819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c8075730 0x7f71c819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 -- 172.21.15.60:0/220803086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71c81101a0 msgr2=0x7f71c81a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71c81101a0 0x7f71c81a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.532+0000 7f71c7fff640 1 -- 172.21.15.60:0/220803086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c81a2670 con 0x7f71c8076080 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.533+0000 7f71c7fff640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 0x7f71c819cca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f71b000d950 tx=0x7f71b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.533+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0017070 con 0x7f71c8076080 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.533+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b0009c30 con 0x7f71c8076080 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.533+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c81a2960 con 0x7f71c8076080 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.533+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b00047a0 con 0x7f71c8076080 2024-09-21T07:33:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.533+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c81a90c0 con 0x7f71c8076080 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.534+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c8075b40 con 0x7f71c8076080 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.535+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f71b0004020 con 0x7f71c8076080 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.536+0000 7f71c5ffb640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b40b6620 0x7f71b40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.536+0000 7f71cc8d9640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b40b6620 0x7f71b40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.536+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f71b00e7030 con 0x7f71c8076080 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.537+0000 7f71cc8d9640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b40b6620 0x7f71b40b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f71c0031440 tx=0x7f71c0009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:16.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.540+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71b0020020 con 0x7f71c8076080 2024-09-21T07:33:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.730+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71c81a93a0 con 0x7f71c8076080 2024-09-21T07:33:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.731+0000 7f71c5ffb640 1 -- 172.21.15.60:0/220803086 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22266 (secure 0 0 0) 0x7f71b00ad810 con 0x7f71c8076080 2024-09-21T07:33:16.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:16.734 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:32:53.917839+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:16.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b40b6620 msgr2=0x7f71b40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b40b6620 0x7f71b40b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f71c0031440 tx=0x7f71c0009560 comp rx=0 tx=0).stop 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 msgr2=0x7f71c819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 0x7f71c819cca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f71b000d950 tx=0x7f71b000de10 comp rx=0 tx=0).stop 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 shutdown_connections 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b40b6620 0x7f71b40b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71c81101a0 0x7f71c81a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c8076080 0x7f71c819cca0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 --2- 172.21.15.60:0/220803086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c8075730 0x7f71c819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 >> 172.21.15.60:0/220803086 conn(0x7f71c807b910 msgr2=0x7f71c81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 shutdown_connections 2024-09-21T07:33:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:16.734+0000 7f71ceb3d640 1 -- 172.21.15.60:0/220803086 wait complete. 2024-09-21T07:33:17.480 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:33:17.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:33:17.741 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:17.862 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:17 smithi060 ceph-mon[31244]: pgmap v296: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-21T07:33:17.862 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:17 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/220803086' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:18.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:17 smithi187 ceph-mon[34367]: pgmap v296: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-21T07:33:18.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:17 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/220803086' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:18.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:17 smithi123 ceph-mon[34166]: pgmap v296: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-21T07:33:18.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:17 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/220803086' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.231+0000 7f9460310640 1 -- 172.21.15.60:0/2096226742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458102000 msgr2=0x7f9458102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.231+0000 7f9460310640 1 --2- 172.21.15.60:0/2096226742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458102000 0x7f9458102410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9454009900 tx=0x7f945402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 -- 172.21.15.60:0/2096226742 shutdown_connections 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 --2- 172.21.15.60:0/2096226742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9458106c30 0x7f9458110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 --2- 172.21.15.60:0/2096226742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94581062e0 0x7f94581066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 --2- 172.21.15.60:0/2096226742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458102000 0x7f9458102410 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 -- 172.21.15.60:0/2096226742 >> 172.21.15.60:0/2096226742 conn(0x7f9458079e40 msgr2=0x7f945807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 -- 172.21.15.60:0/2096226742 shutdown_connections 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 -- 172.21.15.60:0/2096226742 wait complete. 2024-09-21T07:33:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 Processor -- start 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.232+0000 7f9460310640 1 -- start start 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9458102000 0x7f945819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94581062e0 0x7f945819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 0x7f94581a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9458113ad0 con 0x7f9458106c30 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9458113950 con 0x7f9458102000 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9458113c50 con 0x7f94581062e0 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 0x7f94581a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 0x7f94581a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37628/0 (socket says 172.21.15.60:37628) 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 -- 172.21.15.60:0/1107970197 learned_addr learned my addr 172.21.15.60:0/1107970197 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e0ac640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9458102000 0x7f945819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945d8ab640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94581062e0 0x7f945819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 -- 172.21.15.60:0/1107970197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94581062e0 msgr2=0x7f945819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94581062e0 0x7f945819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 -- 172.21.15.60:0/1107970197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9458102000 msgr2=0x7f945819c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9458102000 0x7f945819c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 -- 172.21.15.60:0/1107970197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94581a25f0 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f945e8ad640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 0x7f94581a1f80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f945000cce0 tx=0x7f945000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945000f450 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f945000faa0 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450018b70 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.233+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94581a28e0 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.234+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94581a9100 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.234+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945819d870 con 0x7f9458106c30 2024-09-21T07:33:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.236+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9450018d10 con 0x7f9458106c30 2024-09-21T07:33:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.237+0000 7f944f7fe640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f94440b6650 0x7f94440b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.237+0000 7f945e0ac640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f94440b6650 0x7f94440b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.237+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f94500e75f0 con 0x7f9458106c30 2024-09-21T07:33:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.237+0000 7f945e0ac640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f94440b6650 0x7f94440b8b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9454031440 tx=0x7f9454009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.240+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9450014030 con 0x7f9458106c30 2024-09-21T07:33:18.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.425+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9458103e90 con 0x7f94440b6650 2024-09-21T07:33:18.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.431+0000 7f944f7fe640 1 -- 172.21.15.60:0/1107970197 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258695 (secure 0 0 0) 0x7f9458103e90 con 0x7f94440b6650 2024-09-21T07:33:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-21T07:33:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f94440b6650 msgr2=0x7f94440b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f94440b6650 0x7f94440b8b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9454031440 tx=0x7f9454009560 comp rx=0 tx=0).stop 2024-09-21T07:33:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 msgr2=0x7f94581a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 0x7f94581a1f80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f945000cce0 tx=0x7f945000a620 comp rx=0 tx=0).stop 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 shutdown_connections 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f94440b6650 0x7f94440b8b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9458106c30 0x7f94581a1f80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94581062e0 0x7f945819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 --2- 172.21.15.60:0/1107970197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9458102000 0x7f945819c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 >> 172.21.15.60:0/1107970197 conn(0x7f9458079e40 msgr2=0x7f9458107f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 shutdown_connections 2024-09-21T07:33:18.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:18.434+0000 7f9460310640 1 -- 172.21.15.60:0/1107970197 wait complete. 2024-09-21T07:33:19.211 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-21T07:33:16.604808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648853,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":176,"num_read_kb":175,"num_write":272,"num_write_kb":2252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389764,"kb_used_data":11396,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124552060,"statfs":{"total":1151940427776,"available":1151541309440,"internally_reserved":0,"allocated":11669504,"data_stored":6515320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19154,"internal_metadata":387233070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":54647,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":100,"num_read_kb":111,"num_write":62,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003320"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312774+0000","last_change":"2024-09-21T07:32:53.330750+0000","last_active":"2024-09-21T07:32:54.312774+0000","last_peered":"2024-09-21T07:32:54.312774+0000","last_clean":"2024-09-21T07:32:54.312774+0000","last_became_active":"2024-09-21T07:32:53.330371+0000","last_became_peered":"2024-09-21T07:32:53.330371+0000","last_unstale":"2024-09-21T07:32:54.312774+0000","last_undegraded":"2024-09-21T07:32:54.312774+0000","last_fullsized":"2024-09-21T07:32:54.312774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:53.413349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343001+0000","last_change":"2024-09-21T07:32:53.329867+0000","last_active":"2024-09-21T07:32:54.343001+0000","last_peered":"2024-09-21T07:32:54.343001+0000","last_clean":"2024-09-21T07:32:54.343001+0000","last_became_active":"2024-09-21T07:32:53.329126+0000","last_became_peered":"2024-09-21T07:32:53.329126+0000","last_unstale":"2024-09-21T07:32:54.343001+0000","last_undegraded":"2024-09-21T07:32:54.343001+0000","last_fullsized":"2024-09-21T07:32:54.343001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:42.184172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343004+0000","last_change":"2024-09-21T07:32:53.332835+0000","last_active":"2024-09-21T07:32:54.343004+0000","last_peered":"2024-09-21T07:32:54.343004+0000","last_clean":"2024-09-21T07:32:54.343004+0000","last_became_active":"2024-09-21T07:32:53.332453+0000","last_became_peered":"2024-09-21T07:32:53.332453+0000","last_unstale":"2024-09-21T07:32:54.343004+0000","last_undegraded":"2024-09-21T07:32:54.343004+0000","last_fullsized":"2024-09-21T07:32:54.343004+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:09.376263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342680+0000","last_change":"2024-09-21T07:32:53.332373+0000","last_active":"2024-09-21T07:32:54.342680+0000","last_peered":"2024-09-21T07:32:54.342680+0000","last_clean":"2024-09-21T07:32:54.342680+0000","last_became_active":"2024-09-21T07:32:53.331879+0000","last_became_peered":"2024-09-21T07:32:53.331879+0000","last_unstale":"2024-09-21T07:32:54.342680+0000","last_undegraded":"2024-09-21T07:32:54.342680+0000","last_fullsized":"2024-09-21T07:32:54.342680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:23.843203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333248+0000","last_change":"2024-09-21T07:32:53.327490+0000","last_active":"2024-09-21T07:32:54.333248+0000","last_peered":"2024-09-21T07:32:54.333248+0000","last_clean":"2024-09-21T07:32:54.333248+0000","last_became_active":"2024-09-21T07:32:53.327040+0000","last_became_peered":"2024-09-21T07:32:53.327040+0000","last_unstale":"2024-09-21T07:32:54.333248+0000","last_undegraded":"2024-09-21T07:32:54.333248+0000","last_fullsized":"2024-09-21T07:32:54.333248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.621877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.315195+0000","last_change":"2024-09-21T07:32:53.338026+0000","last_active":"2024-09-21T07:32:54.315195+0000","last_peered":"2024-09-21T07:32:54.315195+0000","last_clean":"2024-09-21T07:32:54.315195+0000","last_became_active":"2024-09-21T07:32:53.337091+0000","last_became_peered":"2024-09-21T07:32:53.337091+0000","last_unstale":"2024-09-21T07:32:54.315195+0000","last_undegraded":"2024-09-21T07:32:54.315195+0000","last_fullsized":"2024-09-21T07:32:54.315195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.363161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343617+0000","last_change":"2024-09-21T07:32:53.333109+0000","last_active":"2024-09-21T07:32:54.343617+0000","last_peered":"2024-09-21T07:32:54.343617+0000","last_clean":"2024-09-21T07:32:54.343617+0000","last_became_active":"2024-09-21T07:32:53.332726+0000","last_became_peered":"2024-09-21T07:32:53.332726+0000","last_unstale":"2024-09-21T07:32:54.343617+0000","last_undegraded":"2024-09-21T07:32:54.343617+0000","last_fullsized":"2024-09-21T07:32:54.343617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:06.553522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339810+0000","last_change":"2024-09-21T07:32:53.335614+0000","last_active":"2024-09-21T07:32:54.339810+0000","last_peered":"2024-09-21T07:32:54.339810+0000","last_clean":"2024-09-21T07:32:54.339810+0000","last_became_active":"2024-09-21T07:32:53.335261+0000","last_became_peered":"2024-09-21T07:32:53.335261+0000","last_unstale":"2024-09-21T07:32:54.339810+0000","last_undegraded":"2024-09-21T07:32:54.339810+0000","last_fullsized":"2024-09-21T07:32:54.339810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:13.143059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343392+0000","last_change":"2024-09-21T07:32:53.333433+0000","last_active":"2024-09-21T07:32:54.343392+0000","last_peered":"2024-09-21T07:32:54.343392+0000","last_clean":"2024-09-21T07:32:54.343392+0000","last_became_active":"2024-09-21T07:32:53.332975+0000","last_became_peered":"2024-09-21T07:32:53.332975+0000","last_unstale":"2024-09-21T07:32:54.343392+0000","last_undegraded":"2024-09-21T07:32:54.343392+0000","last_fullsized":"2024-09-21T07:32:54.343392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:35.820439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.315706+0000","last_change":"2024-09-21T07:32:53.337488+0000","last_active":"2024-09-21T07:32:54.315706+0000","last_peered":"2024-09-21T07:32:54.315706+0000","last_clean":"2024-09-21T07:32:54.315706+0000","last_became_active":"2024-09-21T07:32:53.337104+0000","last_became_peered":"2024-09-21T07:32:53.337104+0000","last_unstale":"2024-09-21T07:32:54.315706+0000","last_undegraded":"2024-09-21T07:32:54.315706+0000","last_fullsized":"2024-09-21T07:32:54.315706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:53.862578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344809+0000","last_change":"2024-09-21T07:32:53.332543+0000","last_active":"2024-09-21T07:32:54.344809+0000","last_peered":"2024-09-21T07:32:54.344809+0000","last_clean":"2024-09-21T07:32:54.344809+0000","last_became_active":"2024-09-21T07:32:53.332174+0000","last_became_peered":"2024-09-21T07:32:53.332174+0000","last_unstale":"2024-09-21T07:32:54.344809+0000","last_undegraded":"2024-09-21T07:32:54.344809+0000","last_fullsized":"2024-09-21T07:32:54.344809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:07.268377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342596+0000","last_change":"2024-09-21T07:32:53.334231+0000","last_active":"2024-09-21T07:32:54.342596+0000","last_peered":"2024-09-21T07:32:54.342596+0000","last_clean":"2024-09-21T07:32:54.342596+0000","last_became_active":"2024-09-21T07:32:53.333838+0000","last_became_peered":"2024-09-21T07:32:53.333838+0000","last_unstale":"2024-09-21T07:32:54.342596+0000","last_undegraded":"2024-09-21T07:32:54.342596+0000","last_fullsized":"2024-09-21T07:32:54.342596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:21.772942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312091+0000","last_change":"2024-09-21T07:32:53.328673+0000","last_active":"2024-09-21T07:32:54.312091+0000","last_peered":"2024-09-21T07:32:54.312091+0000","last_clean":"2024-09-21T07:32:54.312091+0000","last_became_active":"2024-09-21T07:32:53.328355+0000","last_became_peered":"2024-09-21T07:32:53.328355+0000","last_unstale":"2024-09-21T07:32:54.312091+0000","last_undegraded":"2024-09-21T07:32:54.312091+0000","last_fullsized":"2024-09-21T07:32:54.312091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:35.337114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344319+0000","last_change":"2024-09-21T07:32:53.332000+0000","last_active":"2024-09-21T07:32:54.344319+0000","last_peered":"2024-09-21T07:32:54.344319+0000","last_clean":"2024-09-21T07:32:54.344319+0000","last_became_active":"2024-09-21T07:32:53.331304+0000","last_became_peered":"2024-09-21T07:32:53.331304+0000","last_unstale":"2024-09-21T07:32:54.344319+0000","last_undegraded":"2024-09-21T07:32:54.344319+0000","last_fullsized":"2024-09-21T07:32:54.344319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:22.911531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343698+0000","last_change":"2024-09-21T07:32:53.334403+0000","last_active":"2024-09-21T07:32:54.343698+0000","last_peered":"2024-09-21T07:32:54.343698+0000","last_clean":"2024-09-21T07:32:54.343698+0000","last_became_active":"2024-09-21T07:32:53.333927+0000","last_became_peered":"2024-09-21T07:32:53.333927+0000","last_unstale":"2024-09-21T07:32:54.343698+0000","last_undegraded":"2024-09-21T07:32:54.343698+0000","last_fullsized":"2024-09-21T07:32:54.343698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:12.312055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340269+0000","last_change":"2024-09-21T07:32:53.335374+0000","last_active":"2024-09-21T07:32:54.340269+0000","last_peered":"2024-09-21T07:32:54.340269+0000","last_clean":"2024-09-21T07:32:54.340269+0000","last_became_active":"2024-09-21T07:32:53.334880+0000","last_became_peered":"2024-09-21T07:32:53.334880+0000","last_unstale":"2024-09-21T07:32:54.340269+0000","last_undegraded":"2024-09-21T07:32:54.340269+0000","last_fullsized":"2024-09-21T07:32:54.340269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:37.743094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312828+0000","last_change":"2024-09-21T07:32:53.333244+0000","last_active":"2024-09-21T07:32:54.312828+0000","last_peered":"2024-09-21T07:32:54.312828+0000","last_clean":"2024-09-21T07:32:54.312828+0000","last_became_active":"2024-09-21T07:32:53.332067+0000","last_became_peered":"2024-09-21T07:32:53.332067+0000","last_unstale":"2024-09-21T07:32:54.312828+0000","last_undegraded":"2024-09-21T07:32:54.312828+0000","last_fullsized":"2024-09-21T07:32:54.312828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339466+0000","last_change":"2024-09-21T07:32:53.329304+0000","last_active":"2024-09-21T07:32:54.339466+0000","last_peered":"2024-09-21T07:32:54.339466+0000","last_clean":"2024-09-21T07:32:54.339466+0000","last_became_active":"2024-09-21T07:32:53.328921+0000","last_became_peered":"2024-09-21T07:32:53.328921+0000","last_unstale":"2024-09-21T07:32:54.339466+0000","last_undegraded":"2024-09-21T07:32:54.339466+0000","last_fullsized":"2024-09-21T07:32:54.339466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:16.099387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340649+0000","last_change":"2024-09-21T07:32:53.324658+0000","last_active":"2024-09-21T07:32:54.340649+0000","last_peered":"2024-09-21T07:32:54.340649+0000","last_clean":"2024-09-21T07:32:54.340649+0000","last_became_active":"2024-09-21T07:32:53.323584+0000","last_became_peered":"2024-09-21T07:32:53.323584+0000","last_unstale":"2024-09-21T07:32:54.340649+0000","last_undegraded":"2024-09-21T07:32:54.340649+0000","last_fullsized":"2024-09-21T07:32:54.340649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:10.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312389+0000","last_change":"2024-09-21T07:32:53.333037+0000","last_active":"2024-09-21T07:32:54.312389+0000","last_peered":"2024-09-21T07:32:54.312389+0000","last_clean":"2024-09-21T07:32:54.312389+0000","last_became_active":"2024-09-21T07:32:53.332637+0000","last_became_peered":"2024-09-21T07:32:53.332637+0000","last_unstale":"2024-09-21T07:32:54.312389+0000","last_undegraded":"2024-09-21T07:32:54.312389+0000","last_fullsized":"2024-09-21T07:32:54.312389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:18.755351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312101+0000","last_change":"2024-09-21T07:32:53.321185+0000","last_active":"2024-09-21T07:32:54.312101+0000","last_peered":"2024-09-21T07:32:54.312101+0000","last_clean":"2024-09-21T07:32:54.312101+0000","last_became_active":"2024-09-21T07:32:53.320799+0000","last_became_peered":"2024-09-21T07:32:53.320799+0000","last_unstale":"2024-09-21T07:32:54.312101+0000","last_undegraded":"2024-09-21T07:32:54.312101+0000","last_fullsized":"2024-09-21T07:32:54.312101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:45.289546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340685+0000","last_change":"2024-09-21T07:32:53.336314+0000","last_active":"2024-09-21T07:32:54.340685+0000","last_peered":"2024-09-21T07:32:54.340685+0000","last_clean":"2024-09-21T07:32:54.340685+0000","last_became_active":"2024-09-21T07:32:53.335817+0000","last_became_peered":"2024-09-21T07:32:53.335817+0000","last_unstale":"2024-09-21T07:32:54.340685+0000","last_undegraded":"2024-09-21T07:32:54.340685+0000","last_fullsized":"2024-09-21T07:32:54.340685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:02.707523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340752+0000","last_change":"2024-09-21T07:32:53.326396+0000","last_active":"2024-09-21T07:32:54.340752+0000","last_peered":"2024-09-21T07:32:54.340752+0000","last_clean":"2024-09-21T07:32:54.340752+0000","last_became_active":"2024-09-21T07:32:53.325243+0000","last_became_peered":"2024-09-21T07:32:53.325243+0000","last_unstale":"2024-09-21T07:32:54.340752+0000","last_undegraded":"2024-09-21T07:32:54.340752+0000","last_fullsized":"2024-09-21T07:32:54.340752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:42.208673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344670+0000","last_change":"2024-09-21T07:32:53.339639+0000","last_active":"2024-09-21T07:32:54.344670+0000","last_peered":"2024-09-21T07:32:54.344670+0000","last_clean":"2024-09-21T07:32:54.344670+0000","last_became_active":"2024-09-21T07:32:53.337665+0000","last_became_peered":"2024-09-21T07:32:53.337665+0000","last_unstale":"2024-09-21T07:32:54.344670+0000","last_undegraded":"2024-09-21T07:32:54.344670+0000","last_fullsized":"2024-09-21T07:32:54.344670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:58.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340437+0000","last_change":"2024-09-21T07:32:53.334640+0000","last_active":"2024-09-21T07:32:54.340437+0000","last_peered":"2024-09-21T07:32:54.340437+0000","last_clean":"2024-09-21T07:32:54.340437+0000","last_became_active":"2024-09-21T07:32:53.333887+0000","last_became_peered":"2024-09-21T07:32:53.333887+0000","last_unstale":"2024-09-21T07:32:54.340437+0000","last_undegraded":"2024-09-21T07:32:54.340437+0000","last_fullsized":"2024-09-21T07:32:54.340437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:33.577056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340504+0000","last_change":"2024-09-21T07:32:53.329008+0000","last_active":"2024-09-21T07:32:54.340504+0000","last_peered":"2024-09-21T07:32:54.340504+0000","last_clean":"2024-09-21T07:32:54.340504+0000","last_became_active":"2024-09-21T07:32:53.328583+0000","last_became_peered":"2024-09-21T07:32:53.328583+0000","last_unstale":"2024-09-21T07:32:54.340504+0000","last_undegraded":"2024-09-21T07:32:54.340504+0000","last_fullsized":"2024-09-21T07:32:54.340504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:19.879625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312709+0000","last_change":"2024-09-21T07:32:53.330897+0000","last_active":"2024-09-21T07:32:54.312709+0000","last_peered":"2024-09-21T07:32:54.312709+0000","last_clean":"2024-09-21T07:32:54.312709+0000","last_became_active":"2024-09-21T07:32:53.330472+0000","last_became_peered":"2024-09-21T07:32:53.330472+0000","last_unstale":"2024-09-21T07:32:54.312709+0000","last_undegraded":"2024-09-21T07:32:54.312709+0000","last_fullsized":"2024-09-21T07:32:54.312709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:03.845202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312182+0000","last_change":"2024-09-21T07:32:53.331457+0000","last_active":"2024-09-21T07:32:54.312182+0000","last_peered":"2024-09-21T07:32:54.312182+0000","last_clean":"2024-09-21T07:32:54.312182+0000","last_became_active":"2024-09-21T07:32:53.330551+0000","last_became_peered":"2024-09-21T07:32:53.330551+0000","last_unstale":"2024-09-21T07:32:54.312182+0000","last_undegraded":"2024-09-21T07:32:54.312182+0000","last_fullsized":"2024-09-21T07:32:54.312182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:36.419521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343379+0000","last_change":"2024-09-21T07:32:53.334139+0000","last_active":"2024-09-21T07:32:54.343379+0000","last_peered":"2024-09-21T07:32:54.343379+0000","last_clean":"2024-09-21T07:32:54.343379+0000","last_became_active":"2024-09-21T07:32:53.333778+0000","last_became_peered":"2024-09-21T07:32:53.333778+0000","last_unstale":"2024-09-21T07:32:54.343379+0000","last_undegraded":"2024-09-21T07:32:54.343379+0000","last_fullsized":"2024-09-21T07:32:54.343379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:23.964718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340239+0000","last_change":"2024-09-21T07:32:53.328320+0000","last_active":"2024-09-21T07:32:54.340239+0000","last_peered":"2024-09-21T07:32:54.340239+0000","last_clean":"2024-09-21T07:32:54.340239+0000","last_became_active":"2024-09-21T07:32:53.327262+0000","last_became_peered":"2024-09-21T07:32:53.327262+0000","last_unstale":"2024-09-21T07:32:54.340239+0000","last_undegraded":"2024-09-21T07:32:54.340239+0000","last_fullsized":"2024-09-21T07:32:54.340239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:43.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.341493+0000","last_change":"2024-09-21T07:32:53.333008+0000","last_active":"2024-09-21T07:32:54.341493+0000","last_peered":"2024-09-21T07:32:54.341493+0000","last_clean":"2024-09-21T07:32:54.341493+0000","last_became_active":"2024-09-21T07:32:53.332647+0000","last_became_peered":"2024-09-21T07:32:53.332647+0000","last_unstale":"2024-09-21T07:32:54.341493+0000","last_undegraded":"2024-09-21T07:32:54.341493+0000","last_fullsized":"2024-09-21T07:32:54.341493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:29.678179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312357+0000","last_change":"2024-09-21T07:32:53.337814+0000","last_active":"2024-09-21T07:32:54.312357+0000","last_peered":"2024-09-21T07:32:54.312357+0000","last_clean":"2024-09-21T07:32:54.312357+0000","last_became_active":"2024-09-21T07:32:53.337401+0000","last_became_peered":"2024-09-21T07:32:53.337401+0000","last_unstale":"2024-09-21T07:32:54.312357+0000","last_undegraded":"2024-09-21T07:32:54.312357+0000","last_fullsized":"2024-09-21T07:32:54.312357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:33.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333057+0000","last_change":"2024-09-21T07:32:53.329954+0000","last_active":"2024-09-21T07:32:54.333057+0000","last_peered":"2024-09-21T07:32:54.333057+0000","last_clean":"2024-09-21T07:32:54.333057+0000","last_became_active":"2024-09-21T07:32:53.329593+0000","last_became_peered":"2024-09-21T07:32:53.329593+0000","last_unstale":"2024-09-21T07:32:54.333057+0000","last_undegraded":"2024-09-21T07:32:54.333057+0000","last_fullsized":"2024-09-21T07:32:54.333057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:12.032893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:11.399893+0000","last_change":"2024-09-21T07:32:51.321304+0000","last_active":"2024-09-21T07:33:11.399893+0000","last_peered":"2024-09-21T07:33:11.399893+0000","last_clean":"2024-09-21T07:33:11.399893+0000","last_became_active":"2024-09-21T07:32:51.320586+0000","last_became_peered":"2024-09-21T07:32:51.320586+0000","last_unstale":"2024-09-21T07:33:11.399893+0000","last_undegraded":"2024-09-21T07:33:11.399893+0000","last_fullsized":"2024-09-21T07:33:11.399893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.533367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342555+0000","last_change":"2024-09-21T07:32:53.340005+0000","last_active":"2024-09-21T07:32:54.342555+0000","last_peered":"2024-09-21T07:32:54.342555+0000","last_clean":"2024-09-21T07:32:54.342555+0000","last_became_active":"2024-09-21T07:32:53.339433+0000","last_became_peered":"2024-09-21T07:32:53.339433+0000","last_unstale":"2024-09-21T07:32:54.342555+0000","last_undegraded":"2024-09-21T07:32:54.342555+0000","last_fullsized":"2024-09-21T07:32:54.342555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:16.469652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377622+0000","last_change":"2024-09-21T07:32:51.320218+0000","last_active":"2024-09-21T07:33:02.377622+0000","last_peered":"2024-09-21T07:33:02.377622+0000","last_clean":"2024-09-21T07:33:02.377622+0000","last_became_active":"2024-09-21T07:32:51.319793+0000","last_became_peered":"2024-09-21T07:32:51.319793+0000","last_unstale":"2024-09-21T07:33:02.377622+0000","last_undegraded":"2024-09-21T07:33:02.377622+0000","last_fullsized":"2024-09-21T07:33:02.377622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.839505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.375609+0000","last_change":"2024-09-21T07:32:51.313478+0000","last_active":"2024-09-21T07:33:02.375609+0000","last_peered":"2024-09-21T07:33:02.375609+0000","last_clean":"2024-09-21T07:33:02.375609+0000","last_became_active":"2024-09-21T07:32:51.313112+0000","last_became_peered":"2024-09-21T07:32:51.313112+0000","last_unstale":"2024-09-21T07:33:02.375609+0000","last_undegraded":"2024-09-21T07:33:02.375609+0000","last_fullsized":"2024-09-21T07:33:02.375609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.064888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340070+0000","last_change":"2024-09-21T07:32:53.322252+0000","last_active":"2024-09-21T07:32:54.340070+0000","last_peered":"2024-09-21T07:32:54.340070+0000","last_clean":"2024-09-21T07:32:54.340070+0000","last_became_active":"2024-09-21T07:32:53.321919+0000","last_became_peered":"2024-09-21T07:32:53.321919+0000","last_unstale":"2024-09-21T07:32:54.340070+0000","last_undegraded":"2024-09-21T07:32:54.340070+0000","last_fullsized":"2024-09-21T07:32:54.340070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:15.852678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.345257+0000","last_change":"2024-09-21T07:32:51.322190+0000","last_active":"2024-09-21T07:32:54.345257+0000","last_peered":"2024-09-21T07:32:54.345257+0000","last_clean":"2024-09-21T07:32:54.345257+0000","last_became_active":"2024-09-21T07:32:51.321307+0000","last_became_peered":"2024-09-21T07:32:51.321307+0000","last_unstale":"2024-09-21T07:32:54.345257+0000","last_undegraded":"2024-09-21T07:32:54.345257+0000","last_fullsized":"2024-09-21T07:32:54.345257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:23.029068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.338883+0000","last_change":"2024-09-21T07:32:53.323650+0000","last_active":"2024-09-21T07:32:54.338883+0000","last_peered":"2024-09-21T07:32:54.338883+0000","last_clean":"2024-09-21T07:32:54.338883+0000","last_became_active":"2024-09-21T07:32:53.323304+0000","last_became_peered":"2024-09-21T07:32:53.323304+0000","last_unstale":"2024-09-21T07:32:54.338883+0000","last_undegraded":"2024-09-21T07:32:54.338883+0000","last_fullsized":"2024-09-21T07:32:54.338883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.229852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:15.405460+0000","last_change":"2024-09-21T07:32:51.319021+0000","last_active":"2024-09-21T07:33:15.405460+0000","last_peered":"2024-09-21T07:33:15.405460+0000","last_clean":"2024-09-21T07:33:15.405460+0000","last_became_active":"2024-09-21T07:32:51.318150+0000","last_became_peered":"2024-09-21T07:32:51.318150+0000","last_unstale":"2024-09-21T07:33:15.405460+0000","last_undegraded":"2024-09-21T07:33:15.405460+0000","last_fullsized":"2024-09-21T07:33:15.405460+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.408401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342713+0000","last_change":"2024-09-21T07:32:53.327203+0000","last_active":"2024-09-21T07:32:54.342713+0000","last_peered":"2024-09-21T07:32:54.342713+0000","last_clean":"2024-09-21T07:32:54.342713+0000","last_became_active":"2024-09-21T07:32:53.326784+0000","last_became_peered":"2024-09-21T07:32:53.326784+0000","last_unstale":"2024-09-21T07:32:54.342713+0000","last_undegraded":"2024-09-21T07:32:54.342713+0000","last_fullsized":"2024-09-21T07:32:54.342713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.468948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.372911+0000","last_change":"2024-09-21T07:32:51.314749+0000","last_active":"2024-09-21T07:33:01.372911+0000","last_peered":"2024-09-21T07:33:01.372911+0000","last_clean":"2024-09-21T07:33:01.372911+0000","last_became_active":"2024-09-21T07:32:51.314181+0000","last_became_peered":"2024-09-21T07:32:51.314181+0000","last_unstale":"2024-09-21T07:33:01.372911+0000","last_undegraded":"2024-09-21T07:33:01.372911+0000","last_fullsized":"2024-09-21T07:33:01.372911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:22.541053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344073+0000","last_change":"2024-09-21T07:32:53.334410+0000","last_active":"2024-09-21T07:32:54.344073+0000","last_peered":"2024-09-21T07:32:54.344073+0000","last_clean":"2024-09-21T07:32:54.344073+0000","last_became_active":"2024-09-21T07:32:53.334000+0000","last_became_peered":"2024-09-21T07:32:53.334000+0000","last_unstale":"2024-09-21T07:32:54.344073+0000","last_undegraded":"2024-09-21T07:32:54.344073+0000","last_fullsized":"2024-09-21T07:32:54.344073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:11.316706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.371203+0000","last_change":"2024-09-21T07:32:51.959823+0000","last_active":"2024-09-21T07:33:01.371203+0000","last_peered":"2024-09-21T07:33:01.371203+0000","last_clean":"2024-09-21T07:33:01.371203+0000","last_became_active":"2024-09-21T07:32:51.959435+0000","last_became_peered":"2024-09-21T07:32:51.959435+0000","last_unstale":"2024-09-21T07:33:01.371203+0000","last_undegraded":"2024-09-21T07:33:01.371203+0000","last_fullsized":"2024-09-21T07:33:01.371203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:46.394422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342258+0000","last_change":"2024-09-21T07:32:53.334201+0000","last_active":"2024-09-21T07:32:54.342258+0000","last_peered":"2024-09-21T07:32:54.342258+0000","last_clean":"2024-09-21T07:32:54.342258+0000","last_became_active":"2024-09-21T07:32:53.333815+0000","last_became_peered":"2024-09-21T07:32:53.333815+0000","last_unstale":"2024-09-21T07:32:54.342258+0000","last_undegraded":"2024-09-21T07:32:54.342258+0000","last_fullsized":"2024-09-21T07:32:54.342258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:48.783373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'25","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:16.407411+0000","last_change":"2024-09-21T07:32:51.318963+0000","last_active":"2024-09-21T07:33:16.407411+0000","last_peered":"2024-09-21T07:33:16.407411+0000","last_clean":"2024-09-21T07:33:16.407411+0000","last_became_active":"2024-09-21T07:32:51.318560+0000","last_became_peered":"2024-09-21T07:32:51.318560+0000","last_unstale":"2024-09-21T07:33:16.407411+0000","last_undegraded":"2024-09-21T07:33:16.407411+0000","last_fullsized":"2024-09-21T07:33:16.407411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:27.049827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54250,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":69,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333809+0000","last_change":"2024-09-21T07:32:53.326999+0000","last_active":"2024-09-21T07:32:54.333809+0000","last_peered":"2024-09-21T07:32:54.333809+0000","last_clean":"2024-09-21T07:32:54.333809+0000","last_became_active":"2024-09-21T07:32:53.326550+0000","last_became_peered":"2024-09-21T07:32:53.326550+0000","last_unstale":"2024-09-21T07:32:54.333809+0000","last_undegraded":"2024-09-21T07:32:54.333809+0000","last_fullsized":"2024-09-21T07:32:54.333809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:12.036977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377464+0000","last_change":"2024-09-21T07:32:51.317687+0000","last_active":"2024-09-21T07:33:02.377464+0000","last_peered":"2024-09-21T07:33:02.377464+0000","last_clean":"2024-09-21T07:33:02.377464+0000","last_became_active":"2024-09-21T07:32:51.316986+0000","last_became_peered":"2024-09-21T07:32:51.316986+0000","last_unstale":"2024-09-21T07:33:02.377464+0000","last_undegraded":"2024-09-21T07:33:02.377464+0000","last_fullsized":"2024-09-21T07:33:02.377464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:39.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.311773+0000","last_change":"2024-09-21T07:32:53.323562+0000","last_active":"2024-09-21T07:32:54.311773+0000","last_peered":"2024-09-21T07:32:54.311773+0000","last_clean":"2024-09-21T07:32:54.311773+0000","last_became_active":"2024-09-21T07:32:53.323106+0000","last_became_peered":"2024-09-21T07:32:53.323106+0000","last_unstale":"2024-09-21T07:32:54.311773+0000","last_undegraded":"2024-09-21T07:32:54.311773+0000","last_fullsized":"2024-09-21T07:32:54.311773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:24.607014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.373033+0000","last_change":"2024-09-21T07:32:51.320887+0000","last_active":"2024-09-21T07:33:01.373033+0000","last_peered":"2024-09-21T07:33:01.373033+0000","last_clean":"2024-09-21T07:33:01.373033+0000","last_became_active":"2024-09-21T07:32:51.319706+0000","last_became_peered":"2024-09-21T07:32:51.319706+0000","last_unstale":"2024-09-21T07:33:01.373033+0000","last_undegraded":"2024-09-21T07:33:01.373033+0000","last_fullsized":"2024-09-21T07:33:01.373033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:49.594900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344751+0000","last_change":"2024-09-21T07:32:53.330353+0000","last_active":"2024-09-21T07:32:54.344751+0000","last_peered":"2024-09-21T07:32:54.344751+0000","last_clean":"2024-09-21T07:32:54.344751+0000","last_became_active":"2024-09-21T07:32:53.329871+0000","last_became_peered":"2024-09-21T07:32:53.329871+0000","last_unstale":"2024-09-21T07:32:54.344751+0000","last_undegraded":"2024-09-21T07:32:54.344751+0000","last_fullsized":"2024-09-21T07:32:54.344751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:59.075562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:15.406850+0000","last_change":"2024-09-21T07:32:51.319604+0000","last_active":"2024-09-21T07:33:15.406850+0000","last_peered":"2024-09-21T07:33:15.406850+0000","last_clean":"2024-09-21T07:33:15.406850+0000","last_became_active":"2024-09-21T07:32:51.319226+0000","last_became_peered":"2024-09-21T07:32:51.319226+0000","last_unstale":"2024-09-21T07:33:15.406850+0000","last_undegraded":"2024-09-21T07:33:15.406850+0000","last_fullsized":"2024-09-21T07:33:15.406850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:21.724229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343555+0000","last_change":"2024-09-21T07:32:53.332607+0000","last_active":"2024-09-21T07:32:54.343555+0000","last_peered":"2024-09-21T07:32:54.343555+0000","last_clean":"2024-09-21T07:32:54.343555+0000","last_became_active":"2024-09-21T07:32:53.332272+0000","last_became_peered":"2024-09-21T07:32:53.332272+0000","last_unstale":"2024-09-21T07:32:54.343555+0000","last_undegraded":"2024-09-21T07:32:54.343555+0000","last_fullsized":"2024-09-21T07:32:54.343555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:57.193207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.378137+0000","last_change":"2024-09-21T07:32:51.959693+0000","last_active":"2024-09-21T07:33:02.378137+0000","last_peered":"2024-09-21T07:33:02.378137+0000","last_clean":"2024-09-21T07:33:02.378137+0000","last_became_active":"2024-09-21T07:32:51.959276+0000","last_became_peered":"2024-09-21T07:32:51.959276+0000","last_unstale":"2024-09-21T07:33:02.378137+0000","last_undegraded":"2024-09-21T07:33:02.378137+0000","last_fullsized":"2024-09-21T07:33:02.378137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:05.808530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342122+0000","last_change":"2024-09-21T07:32:53.340603+0000","last_active":"2024-09-21T07:32:54.342122+0000","last_peered":"2024-09-21T07:32:54.342122+0000","last_clean":"2024-09-21T07:32:54.342122+0000","last_became_active":"2024-09-21T07:32:53.339451+0000","last_became_peered":"2024-09-21T07:32:53.339451+0000","last_unstale":"2024-09-21T07:32:54.342122+0000","last_undegraded":"2024-09-21T07:32:54.342122+0000","last_fullsized":"2024-09-21T07:32:54.342122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:50.895945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:03.382289+0000","last_change":"2024-09-21T07:32:51.321912+0000","last_active":"2024-09-21T07:33:03.382289+0000","last_peered":"2024-09-21T07:33:03.382289+0000","last_clean":"2024-09-21T07:33:03.382289+0000","last_became_active":"2024-09-21T07:32:51.320880+0000","last_became_peered":"2024-09-21T07:32:51.320880+0000","last_unstale":"2024-09-21T07:33:03.382289+0000","last_undegraded":"2024-09-21T07:33:03.382289+0000","last_fullsized":"2024-09-21T07:33:03.382289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:05.538597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312603+0000","last_change":"2024-09-21T07:32:53.332894+0000","last_active":"2024-09-21T07:32:54.312603+0000","last_peered":"2024-09-21T07:32:54.312603+0000","last_clean":"2024-09-21T07:32:54.312603+0000","last_became_active":"2024-09-21T07:32:53.332489+0000","last_became_peered":"2024-09-21T07:32:53.332489+0000","last_unstale":"2024-09-21T07:32:54.312603+0000","last_undegraded":"2024-09-21T07:32:54.312603+0000","last_fullsized":"2024-09-21T07:32:54.312603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:18.312560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339604+0000","last_change":"2024-09-21T07:32:51.313363+0000","last_active":"2024-09-21T07:32:54.339604+0000","last_peered":"2024-09-21T07:32:54.339604+0000","last_clean":"2024-09-21T07:32:54.339604+0000","last_became_active":"2024-09-21T07:32:51.313001+0000","last_became_peered":"2024-09-21T07:32:51.313001+0000","last_unstale":"2024-09-21T07:32:54.339604+0000","last_undegraded":"2024-09-21T07:32:54.339604+0000","last_fullsized":"2024-09-21T07:32:54.339604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:58.056561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343719+0000","last_change":"2024-09-21T07:32:53.325791+0000","last_active":"2024-09-21T07:32:54.343719+0000","last_peered":"2024-09-21T07:32:54.343719+0000","last_clean":"2024-09-21T07:32:54.343719+0000","last_became_active":"2024-09-21T07:32:53.325406+0000","last_became_peered":"2024-09-21T07:32:53.325406+0000","last_unstale":"2024-09-21T07:32:54.343719+0000","last_undegraded":"2024-09-21T07:32:54.343719+0000","last_fullsized":"2024-09-21T07:32:54.343719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.915438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.347609+0000","last_change":"2024-09-21T07:32:51.318862+0000","last_active":"2024-09-21T07:32:54.347609+0000","last_peered":"2024-09-21T07:32:54.347609+0000","last_clean":"2024-09-21T07:32:54.347609+0000","last_became_active":"2024-09-21T07:32:51.318423+0000","last_became_peered":"2024-09-21T07:32:51.318423+0000","last_unstale":"2024-09-21T07:32:54.347609+0000","last_undegraded":"2024-09-21T07:32:54.347609+0000","last_fullsized":"2024-09-21T07:32:54.347609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:57.438214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344410+0000","last_change":"2024-09-21T07:32:53.333475+0000","last_active":"2024-09-21T07:32:54.344410+0000","last_peered":"2024-09-21T07:32:54.344410+0000","last_clean":"2024-09-21T07:32:54.344410+0000","last_became_active":"2024-09-21T07:32:53.333039+0000","last_became_peered":"2024-09-21T07:32:53.333039+0000","last_unstale":"2024-09-21T07:32:54.344410+0000","last_undegraded":"2024-09-21T07:32:54.344410+0000","last_fullsized":"2024-09-21T07:32:54.344410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:39.510813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377220+0000","last_change":"2024-09-21T07:32:51.958898+0000","last_active":"2024-09-21T07:33:02.377220+0000","last_peered":"2024-09-21T07:33:02.377220+0000","last_clean":"2024-09-21T07:33:02.377220+0000","last_became_active":"2024-09-21T07:32:51.958411+0000","last_became_peered":"2024-09-21T07:32:51.958411+0000","last_unstale":"2024-09-21T07:33:02.377220+0000","last_undegraded":"2024-09-21T07:33:02.377220+0000","last_fullsized":"2024-09-21T07:33:02.377220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:12.375874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344882+0000","last_change":"2024-09-21T07:32:53.331327+0000","last_active":"2024-09-21T07:32:54.344882+0000","last_peered":"2024-09-21T07:32:54.344882+0000","last_clean":"2024-09-21T07:32:54.344882+0000","last_became_active":"2024-09-21T07:32:53.329449+0000","last_became_peered":"2024-09-21T07:32:53.329449+0000","last_unstale":"2024-09-21T07:32:54.344882+0000","last_undegraded":"2024-09-21T07:32:54.344882+0000","last_fullsized":"2024-09-21T07:32:54.344882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:20.605458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":91,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344103+0000","last_change":"2024-09-21T07:31:42.854046+0000","last_active":"2024-09-21T07:32:54.344103+0000","last_peered":"2024-09-21T07:32:54.344103+0000","last_clean":"2024-09-21T07:32:54.344103+0000","last_became_active":"2024-09-21T07:31:42.847659+0000","last_became_peered":"2024-09-21T07:31:42.847659+0000","last_unstale":"2024-09-21T07:32:54.344103+0000","last_undegraded":"2024-09-21T07:32:54.344103+0000","last_fullsized":"2024-09-21T07:32:54.344103+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_clean_scrub_stamp":"2024-09-21T07:28:23.379848+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:17.782511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:03.385079+0000","last_change":"2024-09-21T07:32:51.316842+0000","last_active":"2024-09-21T07:33:03.385079+0000","last_peered":"2024-09-21T07:33:03.385079+0000","last_clean":"2024-09-21T07:33:03.385079+0000","last_became_active":"2024-09-21T07:32:51.316409+0000","last_became_peered":"2024-09-21T07:32:51.316409+0000","last_unstale":"2024-09-21T07:33:03.385079+0000","last_undegraded":"2024-09-21T07:33:03.385079+0000","last_fullsized":"2024-09-21T07:33:03.385079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.648952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339873+0000","last_change":"2024-09-21T07:32:53.331632+0000","last_active":"2024-09-21T07:32:54.339873+0000","last_peered":"2024-09-21T07:32:54.339873+0000","last_clean":"2024-09-21T07:32:54.339873+0000","last_became_active":"2024-09-21T07:32:53.331071+0000","last_became_peered":"2024-09-21T07:32:53.331071+0000","last_unstale":"2024-09-21T07:32:54.339873+0000","last_undegraded":"2024-09-21T07:32:54.339873+0000","last_fullsized":"2024-09-21T07:32:54.339873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:41.568187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377515+0000","last_change":"2024-09-21T07:32:51.319580+0000","last_active":"2024-09-21T07:33:02.377515+0000","last_peered":"2024-09-21T07:33:02.377515+0000","last_clean":"2024-09-21T07:33:02.377515+0000","last_became_active":"2024-09-21T07:32:51.319199+0000","last_became_peered":"2024-09-21T07:32:51.319199+0000","last_unstale":"2024-09-21T07:33:02.377515+0000","last_undegraded":"2024-09-21T07:33:02.377515+0000","last_fullsized":"2024-09-21T07:33:02.377515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.851480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.311682+0000","last_change":"2024-09-21T07:32:53.330969+0000","last_active":"2024-09-21T07:32:54.311682+0000","last_peered":"2024-09-21T07:32:54.311682+0000","last_clean":"2024-09-21T07:32:54.311682+0000","last_became_active":"2024-09-21T07:32:53.329772+0000","last_became_peered":"2024-09-21T07:32:53.329772+0000","last_unstale":"2024-09-21T07:32:54.311682+0000","last_undegraded":"2024-09-21T07:32:54.311682+0000","last_fullsized":"2024-09-21T07:32:54.311682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:23.790114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:10.399400+0000","last_change":"2024-09-21T07:32:51.958596+0000","last_active":"2024-09-21T07:33:10.399400+0000","last_peered":"2024-09-21T07:33:10.399400+0000","last_clean":"2024-09-21T07:33:10.399400+0000","last_became_active":"2024-09-21T07:32:51.958140+0000","last_became_peered":"2024-09-21T07:32:51.958140+0000","last_unstale":"2024-09-21T07:33:10.399400+0000","last_undegraded":"2024-09-21T07:33:10.399400+0000","last_fullsized":"2024-09-21T07:33:10.399400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:43.697003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344454+0000","last_change":"2024-09-21T07:32:53.340627+0000","last_active":"2024-09-21T07:32:54.344454+0000","last_peered":"2024-09-21T07:32:54.344454+0000","last_clean":"2024-09-21T07:32:54.344454+0000","last_became_active":"2024-09-21T07:32:53.340095+0000","last_became_peered":"2024-09-21T07:32:53.340095+0000","last_unstale":"2024-09-21T07:32:54.344454+0000","last_undegraded":"2024-09-21T07:32:54.344454+0000","last_fullsized":"2024-09-21T07:32:54.344454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:55.053809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344651+0000","last_change":"2024-09-21T07:32:51.316441+0000","last_active":"2024-09-21T07:32:54.344651+0000","last_peered":"2024-09-21T07:32:54.344651+0000","last_clean":"2024-09-21T07:32:54.344651+0000","last_became_active":"2024-09-21T07:32:51.315920+0000","last_became_peered":"2024-09-21T07:32:51.315920+0000","last_unstale":"2024-09-21T07:32:54.344651+0000","last_undegraded":"2024-09-21T07:32:54.344651+0000","last_fullsized":"2024-09-21T07:32:54.344651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:06.459155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.315368+0000","last_change":"2024-09-21T07:32:53.338859+0000","last_active":"2024-09-21T07:32:54.315368+0000","last_peered":"2024-09-21T07:32:54.315368+0000","last_clean":"2024-09-21T07:32:54.315368+0000","last_became_active":"2024-09-21T07:32:53.338332+0000","last_became_peered":"2024-09-21T07:32:53.338332+0000","last_unstale":"2024-09-21T07:32:54.315368+0000","last_undegraded":"2024-09-21T07:32:54.315368+0000","last_fullsized":"2024-09-21T07:32:54.315368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.852758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339097+0000","last_change":"2024-09-21T07:32:51.959081+0000","last_active":"2024-09-21T07:32:54.339097+0000","last_peered":"2024-09-21T07:32:54.339097+0000","last_clean":"2024-09-21T07:32:54.339097+0000","last_became_active":"2024-09-21T07:32:51.958701+0000","last_became_peered":"2024-09-21T07:32:51.958701+0000","last_unstale":"2024-09-21T07:32:54.339097+0000","last_undegraded":"2024-09-21T07:32:54.339097+0000","last_fullsized":"2024-09-21T07:32:54.339097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:56.216119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:56.466649+0000","last_change":"2024-09-21T07:32:53.328300+0000","last_active":"2024-09-21T07:32:56.466649+0000","last_peered":"2024-09-21T07:32:56.466649+0000","last_clean":"2024-09-21T07:32:56.466649+0000","last_became_active":"2024-09-21T07:32:53.327485+0000","last_became_peered":"2024-09-21T07:32:53.327485+0000","last_unstale":"2024-09-21T07:32:56.466649+0000","last_undegraded":"2024-09-21T07:32:56.466649+0000","last_fullsized":"2024-09-21T07:32:56.466649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:46.958341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.370568+0000","last_change":"2024-09-21T07:32:51.958430+0000","last_active":"2024-09-21T07:33:01.370568+0000","last_peered":"2024-09-21T07:33:01.370568+0000","last_clean":"2024-09-21T07:33:01.370568+0000","last_became_active":"2024-09-21T07:32:51.957884+0000","last_became_peered":"2024-09-21T07:32:51.957884+0000","last_unstale":"2024-09-21T07:33:01.370568+0000","last_undegraded":"2024-09-21T07:33:01.370568+0000","last_fullsized":"2024-09-21T07:33:01.370568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:31.116439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312293+0000","last_change":"2024-09-21T07:32:53.316991+0000","last_active":"2024-09-21T07:32:54.312293+0000","last_peered":"2024-09-21T07:32:54.312293+0000","last_clean":"2024-09-21T07:32:54.312293+0000","last_became_active":"2024-09-21T07:32:53.316588+0000","last_became_peered":"2024-09-21T07:32:53.316588+0000","last_unstale":"2024-09-21T07:32:54.312293+0000","last_undegraded":"2024-09-21T07:32:54.312293+0000","last_fullsized":"2024-09-21T07:32:54.312293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:04.766114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'5","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:07.337746+0000","last_change":"2024-09-21T07:32:51.317544+0000","last_active":"2024-09-21T07:33:07.337746+0000","last_peered":"2024-09-21T07:33:07.337746+0000","last_clean":"2024-09-21T07:33:07.337746+0000","last_became_active":"2024-09-21T07:32:51.317091+0000","last_became_peered":"2024-09-21T07:32:51.317091+0000","last_unstale":"2024-09-21T07:33:07.337746+0000","last_undegraded":"2024-09-21T07:33:07.337746+0000","last_fullsized":"2024-09-21T07:33:07.337746+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:25.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340691+0000","last_change":"2024-09-21T07:32:53.328118+0000","last_active":"2024-09-21T07:32:54.340691+0000","last_peered":"2024-09-21T07:32:54.340691+0000","last_clean":"2024-09-21T07:32:54.340691+0000","last_became_active":"2024-09-21T07:32:53.327755+0000","last_became_peered":"2024-09-21T07:32:53.327755+0000","last_unstale":"2024-09-21T07:32:54.340691+0000","last_undegraded":"2024-09-21T07:32:54.340691+0000","last_fullsized":"2024-09-21T07:32:54.340691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:00.655258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.370551+0000","last_change":"2024-09-21T07:32:51.566524+0000","last_active":"2024-09-21T07:33:01.370551+0000","last_peered":"2024-09-21T07:33:01.370551+0000","last_clean":"2024-09-21T07:33:01.370551+0000","last_became_active":"2024-09-21T07:32:51.566115+0000","last_became_peered":"2024-09-21T07:32:51.566115+0000","last_unstale":"2024-09-21T07:33:01.370551+0000","last_undegraded":"2024-09-21T07:33:01.370551+0000","last_fullsized":"2024-09-21T07:33:01.370551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:01.098512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343521+0000","last_change":"2024-09-21T07:32:53.334275+0000","last_active":"2024-09-21T07:32:54.343521+0000","last_peered":"2024-09-21T07:32:54.343521+0000","last_clean":"2024-09-21T07:32:54.343521+0000","last_became_active":"2024-09-21T07:32:53.333842+0000","last_became_peered":"2024-09-21T07:32:53.333842+0000","last_unstale":"2024-09-21T07:32:54.343521+0000","last_undegraded":"2024-09-21T07:32:54.343521+0000","last_fullsized":"2024-09-21T07:32:54.343521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:21.370325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.368819+0000","last_change":"2024-09-21T07:32:51.959211+0000","last_active":"2024-09-21T07:33:01.368819+0000","last_peered":"2024-09-21T07:33:01.368819+0000","last_clean":"2024-09-21T07:33:01.368819+0000","last_became_active":"2024-09-21T07:32:51.958887+0000","last_became_peered":"2024-09-21T07:32:51.958887+0000","last_unstale":"2024-09-21T07:33:01.368819+0000","last_undegraded":"2024-09-21T07:33:01.368819+0000","last_fullsized":"2024-09-21T07:33:01.368819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:22.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333080+0000","last_change":"2024-09-21T07:32:53.323125+0000","last_active":"2024-09-21T07:32:54.333080+0000","last_peered":"2024-09-21T07:32:54.333080+0000","last_clean":"2024-09-21T07:32:54.333080+0000","last_became_active":"2024-09-21T07:32:53.322746+0000","last_became_peered":"2024-09-21T07:32:53.322746+0000","last_unstale":"2024-09-21T07:32:54.333080+0000","last_undegraded":"2024-09-21T07:32:54.333080+0000","last_fullsized":"2024-09-21T07:32:54.333080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:53.957518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.371726+0000","last_change":"2024-09-21T07:32:51.314786+0000","last_active":"2024-09-21T07:33:01.371726+0000","last_peered":"2024-09-21T07:33:01.371726+0000","last_clean":"2024-09-21T07:33:01.371726+0000","last_became_active":"2024-09-21T07:32:51.314436+0000","last_became_peered":"2024-09-21T07:32:51.314436+0000","last_unstale":"2024-09-21T07:33:01.371726+0000","last_undegraded":"2024-09-21T07:33:01.371726+0000","last_fullsized":"2024-09-21T07:33:01.371726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:39.672746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312691+0000","last_change":"2024-09-21T07:32:53.332759+0000","last_active":"2024-09-21T07:32:54.312691+0000","last_peered":"2024-09-21T07:32:54.312691+0000","last_clean":"2024-09-21T07:32:54.312691+0000","last_became_active":"2024-09-21T07:32:53.332353+0000","last_became_peered":"2024-09-21T07:32:53.332353+0000","last_unstale":"2024-09-21T07:32:54.312691+0000","last_undegraded":"2024-09-21T07:32:54.312691+0000","last_fullsized":"2024-09-21T07:32:54.312691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:22.561528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342280+0000","last_change":"2024-09-21T07:32:51.318180+0000","last_active":"2024-09-21T07:32:54.342280+0000","last_peered":"2024-09-21T07:32:54.342280+0000","last_clean":"2024-09-21T07:32:54.342280+0000","last_became_active":"2024-09-21T07:32:51.317630+0000","last_became_peered":"2024-09-21T07:32:51.317630+0000","last_unstale":"2024-09-21T07:32:54.342280+0000","last_undegraded":"2024-09-21T07:32:54.342280+0000","last_fullsized":"2024-09-21T07:32:54.342280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.976579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340823+0000","last_change":"2024-09-21T07:32:53.326166+0000","last_active":"2024-09-21T07:32:54.340823+0000","last_peered":"2024-09-21T07:32:54.340823+0000","last_clean":"2024-09-21T07:32:54.340823+0000","last_became_active":"2024-09-21T07:32:53.325797+0000","last_became_peered":"2024-09-21T07:32:53.325797+0000","last_unstale":"2024-09-21T07:32:54.340823+0000","last_undegraded":"2024-09-21T07:32:54.340823+0000","last_fullsized":"2024-09-21T07:32:54.340823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:43.130088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.371972+0000","last_change":"2024-09-21T07:32:51.323554+0000","last_active":"2024-09-21T07:33:01.371972+0000","last_peered":"2024-09-21T07:33:01.371972+0000","last_clean":"2024-09-21T07:33:01.371972+0000","last_became_active":"2024-09-21T07:32:51.322847+0000","last_became_peered":"2024-09-21T07:32:51.322847+0000","last_unstale":"2024-09-21T07:33:01.371972+0000","last_undegraded":"2024-09-21T07:33:01.371972+0000","last_fullsized":"2024-09-21T07:33:01.371972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:23.102513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344229+0000","last_change":"2024-09-21T07:32:53.330124+0000","last_active":"2024-09-21T07:32:54.344229+0000","last_peered":"2024-09-21T07:32:54.344229+0000","last_clean":"2024-09-21T07:32:54.344229+0000","last_became_active":"2024-09-21T07:32:53.329497+0000","last_became_peered":"2024-09-21T07:32:53.329497+0000","last_unstale":"2024-09-21T07:32:54.344229+0000","last_undegraded":"2024-09-21T07:32:54.344229+0000","last_fullsized":"2024-09-21T07:32:54.344229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:40.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343756+0000","last_change":"2024-09-21T07:32:53.340492+0000","last_active":"2024-09-21T07:32:54.343756+0000","last_peered":"2024-09-21T07:32:54.343756+0000","last_clean":"2024-09-21T07:32:54.343756+0000","last_became_active":"2024-09-21T07:32:53.339535+0000","last_became_peered":"2024-09-21T07:32:53.339535+0000","last_unstale":"2024-09-21T07:32:54.343756+0000","last_undegraded":"2024-09-21T07:32:54.343756+0000","last_fullsized":"2024-09-21T07:32:54.343756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:01.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344473+0000","last_change":"2024-09-21T07:32:51.321423+0000","last_active":"2024-09-21T07:32:54.344473+0000","last_peered":"2024-09-21T07:32:54.344473+0000","last_clean":"2024-09-21T07:32:54.344473+0000","last_became_active":"2024-09-21T07:32:51.320844+0000","last_became_peered":"2024-09-21T07:32:51.320844+0000","last_unstale":"2024-09-21T07:32:54.344473+0000","last_undegraded":"2024-09-21T07:32:54.344473+0000","last_fullsized":"2024-09-21T07:32:54.344473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.771991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.341509+0000","last_change":"2024-09-21T07:32:53.337661+0000","last_active":"2024-09-21T07:32:54.341509+0000","last_peered":"2024-09-21T07:32:54.341509+0000","last_clean":"2024-09-21T07:32:54.341509+0000","last_became_active":"2024-09-21T07:32:53.337269+0000","last_became_peered":"2024-09-21T07:32:53.337269+0000","last_unstale":"2024-09-21T07:32:54.341509+0000","last_undegraded":"2024-09-21T07:32:54.341509+0000","last_fullsized":"2024-09-21T07:32:54.341509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:31.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377696+0000","last_change":"2024-09-21T07:32:51.323429+0000","last_active":"2024-09-21T07:33:02.377696+0000","last_peered":"2024-09-21T07:33:02.377696+0000","last_clean":"2024-09-21T07:33:02.377696+0000","last_became_active":"2024-09-21T07:32:51.323037+0000","last_became_peered":"2024-09-21T07:32:51.323037+0000","last_unstale":"2024-09-21T07:33:02.377696+0000","last_undegraded":"2024-09-21T07:33:02.377696+0000","last_fullsized":"2024-09-21T07:33:02.377696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:38.797479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343867+0000","last_change":"2024-09-21T07:32:53.327544+0000","last_active":"2024-09-21T07:32:54.343867+0000","last_peered":"2024-09-21T07:32:54.343867+0000","last_clean":"2024-09-21T07:32:54.343867+0000","last_became_active":"2024-09-21T07:32:53.326960+0000","last_became_peered":"2024-09-21T07:32:53.326960+0000","last_unstale":"2024-09-21T07:32:54.343867+0000","last_undegraded":"2024-09-21T07:32:54.343867+0000","last_fullsized":"2024-09-21T07:32:54.343867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:47.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.346110+0000","last_change":"2024-09-21T07:32:51.959814+0000","last_active":"2024-09-21T07:32:54.346110+0000","last_peered":"2024-09-21T07:32:54.346110+0000","last_clean":"2024-09-21T07:32:54.346110+0000","last_became_active":"2024-09-21T07:32:51.957948+0000","last_became_peered":"2024-09-21T07:32:51.957948+0000","last_unstale":"2024-09-21T07:32:54.346110+0000","last_undegraded":"2024-09-21T07:32:54.346110+0000","last_fullsized":"2024-09-21T07:32:54.346110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:34.949022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.341670+0000","last_change":"2024-09-21T07:32:53.328689+0000","last_active":"2024-09-21T07:32:54.341670+0000","last_peered":"2024-09-21T07:32:54.341670+0000","last_clean":"2024-09-21T07:32:54.341670+0000","last_became_active":"2024-09-21T07:32:53.328340+0000","last_became_peered":"2024-09-21T07:32:53.328340+0000","last_unstale":"2024-09-21T07:32:54.341670+0000","last_undegraded":"2024-09-21T07:32:54.341670+0000","last_fullsized":"2024-09-21T07:32:54.341670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:11.294632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.378416+0000","last_change":"2024-09-21T07:32:51.317674+0000","last_active":"2024-09-21T07:33:02.378416+0000","last_peered":"2024-09-21T07:33:02.378416+0000","last_clean":"2024-09-21T07:33:02.378416+0000","last_became_active":"2024-09-21T07:32:51.317097+0000","last_became_peered":"2024-09-21T07:32:51.317097+0000","last_unstale":"2024-09-21T07:33:02.378416+0000","last_undegraded":"2024-09-21T07:33:02.378416+0000","last_fullsized":"2024-09-21T07:33:02.378416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.144187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58251,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":100,"num_read_kb":111,"num_write":147,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":165706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776145,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":794624,"data_stored":383415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":31914435},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1029537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135897,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":383651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299423,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":811008,"data_stored":383571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32556,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712596,"statfs":{"total":95995035648,"available":95961698304,"internally_reserved":0,"allocated":1404928,"data_stored":975501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40284,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704868,"statfs":{"total":95995035648,"available":95953784832,"internally_reserved":0,"allocated":798720,"data_stored":383040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32568,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712584,"statfs":{"total":95995035648,"available":95961686016,"internally_reserved":0,"allocated":1417216,"data_stored":974794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":383868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":383351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":413198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607620,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":437083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":384311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":46553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:19.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:33:19.474 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:19.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:19 smithi060 ceph-mon[31244]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:33:19.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:19 smithi060 ceph-mon[31244]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-21T07:33:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 -- 172.21.15.60:0/2654956295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c41083a0 msgr2=0x7f43c41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/2654956295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c41083a0 0x7f43c41087b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009900 tx=0x7f43b402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 -- 172.21.15.60:0/2654956295 shutdown_connections 2024-09-21T07:33:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/2654956295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c4108cf0 0x7f43c410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/2654956295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c41083a0 0x7f43c41087b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/2654956295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43c4102a60 0x7f43c4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 -- 172.21.15.60:0/2654956295 >> 172.21.15.60:0/2654956295 conn(0x7f43c4079730 msgr2=0x7f43c4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 -- 172.21.15.60:0/2654956295 shutdown_connections 2024-09-21T07:33:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 -- 172.21.15.60:0/2654956295 wait complete. 2024-09-21T07:33:19.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.907+0000 7f43c9f7b640 1 Processor -- start 2024-09-21T07:33:19.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 -- start start 2024-09-21T07:33:19.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 0x7f43c419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43c41083a0 0x7f43c419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c4108cf0 0x7f43c419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4113a80 con 0x7f43c4102a60 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4113900 con 0x7f43c4108cf0 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c9f7b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4113c00 con 0x7f43c41083a0 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 0x7f43c419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 0x7f43c419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37642/0 (socket says 172.21.15.60:37642) 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 -- 172.21.15.60:0/303124757 learned_addr learned my addr 172.21.15.60:0/303124757 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c2ffd640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43c41083a0 0x7f43c419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:19.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c3fff640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c4108cf0 0x7f43c419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 -- 172.21.15.60:0/303124757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43c41083a0 msgr2=0x7f43c419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43c41083a0 0x7f43c419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 -- 172.21.15.60:0/303124757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c4108cf0 msgr2=0x7f43c419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c4108cf0 0x7f43c419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.908+0000 7f43c37fe640 1 -- 172.21.15.60:0/303124757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c41a04a0 con 0x7f43c4102a60 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.909+0000 7f43c37fe640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 0x7f43c419a530 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00e9f0 tx=0x7f43ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.909+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00cd80 con 0x7f43c4102a60 2024-09-21T07:33:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.909+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ac0054d0 con 0x7f43c4102a60 2024-09-21T07:33:19.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.909+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c41a0790 con 0x7f43c4102a60 2024-09-21T07:33:19.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.909+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac010690 con 0x7f43c4102a60 2024-09-21T07:33:19.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.909+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c41a6ef0 con 0x7f43c4102a60 2024-09-21T07:33:19.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.910+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c4102e70 con 0x7f43c4102a60 2024-09-21T07:33:19.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.911+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f43ac004e90 con 0x7f43c4102a60 2024-09-21T07:33:19.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.912+0000 7f43c0ff9640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f43b00b6620 0x7f43b00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:19.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.912+0000 7f43c2ffd640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f43b00b6620 0x7f43b00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:19.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.912+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f43ac0e7730 con 0x7f43c4102a60 2024-09-21T07:33:19.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.913+0000 7f43c2ffd640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f43b00b6620 0x7f43b00b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43b4000c00 tx=0x7f43b4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:19.917+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43ac0ae010 con 0x7f43c4102a60 2024-09-21T07:33:20.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:19 smithi187 ceph-mon[34367]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:33:20.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:19 smithi187 ceph-mon[34367]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-21T07:33:20.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:19 smithi123 ceph-mon[34166]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:33:20.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:19 smithi123 ceph-mon[34166]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-21T07:33:20.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.105+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43c4063800 con 0x7f43b00b6620 2024-09-21T07:33:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.110+0000 7f43c0ff9640 1 -- 172.21.15.60:0/303124757 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258696 (secure 0 0 0) 0x7f43c4063800 con 0x7f43b00b6620 2024-09-21T07:33:20.114 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-21T07:33:20.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.113+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f43b00b6620 msgr2=0x7f43b00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.113+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f43b00b6620 0x7f43b00b8b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f43b4000c00 tx=0x7f43b4031400 comp rx=0 tx=0).stop 2024-09-21T07:33:20.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.113+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 msgr2=0x7f43c419a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.113+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 0x7f43c419a530 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00e9f0 tx=0x7f43ac00edf0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 shutdown_connections 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f43b00b6620 0x7f43b00b8b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c4108cf0 0x7f43c419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43c41083a0 0x7f43c419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 --2- 172.21.15.60:0/303124757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43c4102a60 0x7f43c419a530 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 >> 172.21.15.60:0/303124757 conn(0x7f43c4079730 msgr2=0x7f43c4104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 shutdown_connections 2024-09-21T07:33:20.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:20.114+0000 7f43c9f7b640 1 -- 172.21.15.60:0/303124757 wait complete. 2024-09-21T07:33:20.884 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-21T07:33:18.605260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648853,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":186,"num_read_kb":180,"num_write":279,"num_write_kb":2254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":389792,"kb_used_data":11424,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124552032,"statfs":{"total":1151940427776,"available":1151541280768,"internally_reserved":0,"allocated":11698176,"data_stored":6540555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19154,"internal_metadata":387233070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53935,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":86,"num_read_kb":100,"num_write":56,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003253"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312774+0000","last_change":"2024-09-21T07:32:53.330750+0000","last_active":"2024-09-21T07:32:54.312774+0000","last_peered":"2024-09-21T07:32:54.312774+0000","last_clean":"2024-09-21T07:32:54.312774+0000","last_became_active":"2024-09-21T07:32:53.330371+0000","last_became_peered":"2024-09-21T07:32:53.330371+0000","last_unstale":"2024-09-21T07:32:54.312774+0000","last_undegraded":"2024-09-21T07:32:54.312774+0000","last_fullsized":"2024-09-21T07:32:54.312774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:53.413349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343001+0000","last_change":"2024-09-21T07:32:53.329867+0000","last_active":"2024-09-21T07:32:54.343001+0000","last_peered":"2024-09-21T07:32:54.343001+0000","last_clean":"2024-09-21T07:32:54.343001+0000","last_became_active":"2024-09-21T07:32:53.329126+0000","last_became_peered":"2024-09-21T07:32:53.329126+0000","last_unstale":"2024-09-21T07:32:54.343001+0000","last_undegraded":"2024-09-21T07:32:54.343001+0000","last_fullsized":"2024-09-21T07:32:54.343001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:42.184172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343004+0000","last_change":"2024-09-21T07:32:53.332835+0000","last_active":"2024-09-21T07:32:54.343004+0000","last_peered":"2024-09-21T07:32:54.343004+0000","last_clean":"2024-09-21T07:32:54.343004+0000","last_became_active":"2024-09-21T07:32:53.332453+0000","last_became_peered":"2024-09-21T07:32:53.332453+0000","last_unstale":"2024-09-21T07:32:54.343004+0000","last_undegraded":"2024-09-21T07:32:54.343004+0000","last_fullsized":"2024-09-21T07:32:54.343004+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:09.376263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342680+0000","last_change":"2024-09-21T07:32:53.332373+0000","last_active":"2024-09-21T07:32:54.342680+0000","last_peered":"2024-09-21T07:32:54.342680+0000","last_clean":"2024-09-21T07:32:54.342680+0000","last_became_active":"2024-09-21T07:32:53.331879+0000","last_became_peered":"2024-09-21T07:32:53.331879+0000","last_unstale":"2024-09-21T07:32:54.342680+0000","last_undegraded":"2024-09-21T07:32:54.342680+0000","last_fullsized":"2024-09-21T07:32:54.342680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:23.843203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333248+0000","last_change":"2024-09-21T07:32:53.327490+0000","last_active":"2024-09-21T07:32:54.333248+0000","last_peered":"2024-09-21T07:32:54.333248+0000","last_clean":"2024-09-21T07:32:54.333248+0000","last_became_active":"2024-09-21T07:32:53.327040+0000","last_became_peered":"2024-09-21T07:32:53.327040+0000","last_unstale":"2024-09-21T07:32:54.333248+0000","last_undegraded":"2024-09-21T07:32:54.333248+0000","last_fullsized":"2024-09-21T07:32:54.333248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.621877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.315195+0000","last_change":"2024-09-21T07:32:53.338026+0000","last_active":"2024-09-21T07:32:54.315195+0000","last_peered":"2024-09-21T07:32:54.315195+0000","last_clean":"2024-09-21T07:32:54.315195+0000","last_became_active":"2024-09-21T07:32:53.337091+0000","last_became_peered":"2024-09-21T07:32:53.337091+0000","last_unstale":"2024-09-21T07:32:54.315195+0000","last_undegraded":"2024-09-21T07:32:54.315195+0000","last_fullsized":"2024-09-21T07:32:54.315195+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.363161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343617+0000","last_change":"2024-09-21T07:32:53.333109+0000","last_active":"2024-09-21T07:32:54.343617+0000","last_peered":"2024-09-21T07:32:54.343617+0000","last_clean":"2024-09-21T07:32:54.343617+0000","last_became_active":"2024-09-21T07:32:53.332726+0000","last_became_peered":"2024-09-21T07:32:53.332726+0000","last_unstale":"2024-09-21T07:32:54.343617+0000","last_undegraded":"2024-09-21T07:32:54.343617+0000","last_fullsized":"2024-09-21T07:32:54.343617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:06.553522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339810+0000","last_change":"2024-09-21T07:32:53.335614+0000","last_active":"2024-09-21T07:32:54.339810+0000","last_peered":"2024-09-21T07:32:54.339810+0000","last_clean":"2024-09-21T07:32:54.339810+0000","last_became_active":"2024-09-21T07:32:53.335261+0000","last_became_peered":"2024-09-21T07:32:53.335261+0000","last_unstale":"2024-09-21T07:32:54.339810+0000","last_undegraded":"2024-09-21T07:32:54.339810+0000","last_fullsized":"2024-09-21T07:32:54.339810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:13.143059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343392+0000","last_change":"2024-09-21T07:32:53.333433+0000","last_active":"2024-09-21T07:32:54.343392+0000","last_peered":"2024-09-21T07:32:54.343392+0000","last_clean":"2024-09-21T07:32:54.343392+0000","last_became_active":"2024-09-21T07:32:53.332975+0000","last_became_peered":"2024-09-21T07:32:53.332975+0000","last_unstale":"2024-09-21T07:32:54.343392+0000","last_undegraded":"2024-09-21T07:32:54.343392+0000","last_fullsized":"2024-09-21T07:32:54.343392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:35.820439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.315706+0000","last_change":"2024-09-21T07:32:53.337488+0000","last_active":"2024-09-21T07:32:54.315706+0000","last_peered":"2024-09-21T07:32:54.315706+0000","last_clean":"2024-09-21T07:32:54.315706+0000","last_became_active":"2024-09-21T07:32:53.337104+0000","last_became_peered":"2024-09-21T07:32:53.337104+0000","last_unstale":"2024-09-21T07:32:54.315706+0000","last_undegraded":"2024-09-21T07:32:54.315706+0000","last_fullsized":"2024-09-21T07:32:54.315706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:53.862578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344809+0000","last_change":"2024-09-21T07:32:53.332543+0000","last_active":"2024-09-21T07:32:54.344809+0000","last_peered":"2024-09-21T07:32:54.344809+0000","last_clean":"2024-09-21T07:32:54.344809+0000","last_became_active":"2024-09-21T07:32:53.332174+0000","last_became_peered":"2024-09-21T07:32:53.332174+0000","last_unstale":"2024-09-21T07:32:54.344809+0000","last_undegraded":"2024-09-21T07:32:54.344809+0000","last_fullsized":"2024-09-21T07:32:54.344809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:07.268377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342596+0000","last_change":"2024-09-21T07:32:53.334231+0000","last_active":"2024-09-21T07:32:54.342596+0000","last_peered":"2024-09-21T07:32:54.342596+0000","last_clean":"2024-09-21T07:32:54.342596+0000","last_became_active":"2024-09-21T07:32:53.333838+0000","last_became_peered":"2024-09-21T07:32:53.333838+0000","last_unstale":"2024-09-21T07:32:54.342596+0000","last_undegraded":"2024-09-21T07:32:54.342596+0000","last_fullsized":"2024-09-21T07:32:54.342596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:21.772942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312091+0000","last_change":"2024-09-21T07:32:53.328673+0000","last_active":"2024-09-21T07:32:54.312091+0000","last_peered":"2024-09-21T07:32:54.312091+0000","last_clean":"2024-09-21T07:32:54.312091+0000","last_became_active":"2024-09-21T07:32:53.328355+0000","last_became_peered":"2024-09-21T07:32:53.328355+0000","last_unstale":"2024-09-21T07:32:54.312091+0000","last_undegraded":"2024-09-21T07:32:54.312091+0000","last_fullsized":"2024-09-21T07:32:54.312091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:35.337114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344319+0000","last_change":"2024-09-21T07:32:53.332000+0000","last_active":"2024-09-21T07:32:54.344319+0000","last_peered":"2024-09-21T07:32:54.344319+0000","last_clean":"2024-09-21T07:32:54.344319+0000","last_became_active":"2024-09-21T07:32:53.331304+0000","last_became_peered":"2024-09-21T07:32:53.331304+0000","last_unstale":"2024-09-21T07:32:54.344319+0000","last_undegraded":"2024-09-21T07:32:54.344319+0000","last_fullsized":"2024-09-21T07:32:54.344319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:22.911531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343698+0000","last_change":"2024-09-21T07:32:53.334403+0000","last_active":"2024-09-21T07:32:54.343698+0000","last_peered":"2024-09-21T07:32:54.343698+0000","last_clean":"2024-09-21T07:32:54.343698+0000","last_became_active":"2024-09-21T07:32:53.333927+0000","last_became_peered":"2024-09-21T07:32:53.333927+0000","last_unstale":"2024-09-21T07:32:54.343698+0000","last_undegraded":"2024-09-21T07:32:54.343698+0000","last_fullsized":"2024-09-21T07:32:54.343698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:12.312055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340269+0000","last_change":"2024-09-21T07:32:53.335374+0000","last_active":"2024-09-21T07:32:54.340269+0000","last_peered":"2024-09-21T07:32:54.340269+0000","last_clean":"2024-09-21T07:32:54.340269+0000","last_became_active":"2024-09-21T07:32:53.334880+0000","last_became_peered":"2024-09-21T07:32:53.334880+0000","last_unstale":"2024-09-21T07:32:54.340269+0000","last_undegraded":"2024-09-21T07:32:54.340269+0000","last_fullsized":"2024-09-21T07:32:54.340269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:37.743094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312828+0000","last_change":"2024-09-21T07:32:53.333244+0000","last_active":"2024-09-21T07:32:54.312828+0000","last_peered":"2024-09-21T07:32:54.312828+0000","last_clean":"2024-09-21T07:32:54.312828+0000","last_became_active":"2024-09-21T07:32:53.332067+0000","last_became_peered":"2024-09-21T07:32:53.332067+0000","last_unstale":"2024-09-21T07:32:54.312828+0000","last_undegraded":"2024-09-21T07:32:54.312828+0000","last_fullsized":"2024-09-21T07:32:54.312828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339466+0000","last_change":"2024-09-21T07:32:53.329304+0000","last_active":"2024-09-21T07:32:54.339466+0000","last_peered":"2024-09-21T07:32:54.339466+0000","last_clean":"2024-09-21T07:32:54.339466+0000","last_became_active":"2024-09-21T07:32:53.328921+0000","last_became_peered":"2024-09-21T07:32:53.328921+0000","last_unstale":"2024-09-21T07:32:54.339466+0000","last_undegraded":"2024-09-21T07:32:54.339466+0000","last_fullsized":"2024-09-21T07:32:54.339466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:16.099387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340649+0000","last_change":"2024-09-21T07:32:53.324658+0000","last_active":"2024-09-21T07:32:54.340649+0000","last_peered":"2024-09-21T07:32:54.340649+0000","last_clean":"2024-09-21T07:32:54.340649+0000","last_became_active":"2024-09-21T07:32:53.323584+0000","last_became_peered":"2024-09-21T07:32:53.323584+0000","last_unstale":"2024-09-21T07:32:54.340649+0000","last_undegraded":"2024-09-21T07:32:54.340649+0000","last_fullsized":"2024-09-21T07:32:54.340649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:10.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312389+0000","last_change":"2024-09-21T07:32:53.333037+0000","last_active":"2024-09-21T07:32:54.312389+0000","last_peered":"2024-09-21T07:32:54.312389+0000","last_clean":"2024-09-21T07:32:54.312389+0000","last_became_active":"2024-09-21T07:32:53.332637+0000","last_became_peered":"2024-09-21T07:32:53.332637+0000","last_unstale":"2024-09-21T07:32:54.312389+0000","last_undegraded":"2024-09-21T07:32:54.312389+0000","last_fullsized":"2024-09-21T07:32:54.312389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:18.755351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312101+0000","last_change":"2024-09-21T07:32:53.321185+0000","last_active":"2024-09-21T07:32:54.312101+0000","last_peered":"2024-09-21T07:32:54.312101+0000","last_clean":"2024-09-21T07:32:54.312101+0000","last_became_active":"2024-09-21T07:32:53.320799+0000","last_became_peered":"2024-09-21T07:32:53.320799+0000","last_unstale":"2024-09-21T07:32:54.312101+0000","last_undegraded":"2024-09-21T07:32:54.312101+0000","last_fullsized":"2024-09-21T07:32:54.312101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:45.289546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340685+0000","last_change":"2024-09-21T07:32:53.336314+0000","last_active":"2024-09-21T07:32:54.340685+0000","last_peered":"2024-09-21T07:32:54.340685+0000","last_clean":"2024-09-21T07:32:54.340685+0000","last_became_active":"2024-09-21T07:32:53.335817+0000","last_became_peered":"2024-09-21T07:32:53.335817+0000","last_unstale":"2024-09-21T07:32:54.340685+0000","last_undegraded":"2024-09-21T07:32:54.340685+0000","last_fullsized":"2024-09-21T07:32:54.340685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:02.707523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340752+0000","last_change":"2024-09-21T07:32:53.326396+0000","last_active":"2024-09-21T07:32:54.340752+0000","last_peered":"2024-09-21T07:32:54.340752+0000","last_clean":"2024-09-21T07:32:54.340752+0000","last_became_active":"2024-09-21T07:32:53.325243+0000","last_became_peered":"2024-09-21T07:32:53.325243+0000","last_unstale":"2024-09-21T07:32:54.340752+0000","last_undegraded":"2024-09-21T07:32:54.340752+0000","last_fullsized":"2024-09-21T07:32:54.340752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:42.208673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344670+0000","last_change":"2024-09-21T07:32:53.339639+0000","last_active":"2024-09-21T07:32:54.344670+0000","last_peered":"2024-09-21T07:32:54.344670+0000","last_clean":"2024-09-21T07:32:54.344670+0000","last_became_active":"2024-09-21T07:32:53.337665+0000","last_became_peered":"2024-09-21T07:32:53.337665+0000","last_unstale":"2024-09-21T07:32:54.344670+0000","last_undegraded":"2024-09-21T07:32:54.344670+0000","last_fullsized":"2024-09-21T07:32:54.344670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:58.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340437+0000","last_change":"2024-09-21T07:32:53.334640+0000","last_active":"2024-09-21T07:32:54.340437+0000","last_peered":"2024-09-21T07:32:54.340437+0000","last_clean":"2024-09-21T07:32:54.340437+0000","last_became_active":"2024-09-21T07:32:53.333887+0000","last_became_peered":"2024-09-21T07:32:53.333887+0000","last_unstale":"2024-09-21T07:32:54.340437+0000","last_undegraded":"2024-09-21T07:32:54.340437+0000","last_fullsized":"2024-09-21T07:32:54.340437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:33.577056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340504+0000","last_change":"2024-09-21T07:32:53.329008+0000","last_active":"2024-09-21T07:32:54.340504+0000","last_peered":"2024-09-21T07:32:54.340504+0000","last_clean":"2024-09-21T07:32:54.340504+0000","last_became_active":"2024-09-21T07:32:53.328583+0000","last_became_peered":"2024-09-21T07:32:53.328583+0000","last_unstale":"2024-09-21T07:32:54.340504+0000","last_undegraded":"2024-09-21T07:32:54.340504+0000","last_fullsized":"2024-09-21T07:32:54.340504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:19.879625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312709+0000","last_change":"2024-09-21T07:32:53.330897+0000","last_active":"2024-09-21T07:32:54.312709+0000","last_peered":"2024-09-21T07:32:54.312709+0000","last_clean":"2024-09-21T07:32:54.312709+0000","last_became_active":"2024-09-21T07:32:53.330472+0000","last_became_peered":"2024-09-21T07:32:53.330472+0000","last_unstale":"2024-09-21T07:32:54.312709+0000","last_undegraded":"2024-09-21T07:32:54.312709+0000","last_fullsized":"2024-09-21T07:32:54.312709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:03.845202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312182+0000","last_change":"2024-09-21T07:32:53.331457+0000","last_active":"2024-09-21T07:32:54.312182+0000","last_peered":"2024-09-21T07:32:54.312182+0000","last_clean":"2024-09-21T07:32:54.312182+0000","last_became_active":"2024-09-21T07:32:53.330551+0000","last_became_peered":"2024-09-21T07:32:53.330551+0000","last_unstale":"2024-09-21T07:32:54.312182+0000","last_undegraded":"2024-09-21T07:32:54.312182+0000","last_fullsized":"2024-09-21T07:32:54.312182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:36.419521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343379+0000","last_change":"2024-09-21T07:32:53.334139+0000","last_active":"2024-09-21T07:32:54.343379+0000","last_peered":"2024-09-21T07:32:54.343379+0000","last_clean":"2024-09-21T07:32:54.343379+0000","last_became_active":"2024-09-21T07:32:53.333778+0000","last_became_peered":"2024-09-21T07:32:53.333778+0000","last_unstale":"2024-09-21T07:32:54.343379+0000","last_undegraded":"2024-09-21T07:32:54.343379+0000","last_fullsized":"2024-09-21T07:32:54.343379+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:23.964718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340239+0000","last_change":"2024-09-21T07:32:53.328320+0000","last_active":"2024-09-21T07:32:54.340239+0000","last_peered":"2024-09-21T07:32:54.340239+0000","last_clean":"2024-09-21T07:32:54.340239+0000","last_became_active":"2024-09-21T07:32:53.327262+0000","last_became_peered":"2024-09-21T07:32:53.327262+0000","last_unstale":"2024-09-21T07:32:54.340239+0000","last_undegraded":"2024-09-21T07:32:54.340239+0000","last_fullsized":"2024-09-21T07:32:54.340239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:43.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.341493+0000","last_change":"2024-09-21T07:32:53.333008+0000","last_active":"2024-09-21T07:32:54.341493+0000","last_peered":"2024-09-21T07:32:54.341493+0000","last_clean":"2024-09-21T07:32:54.341493+0000","last_became_active":"2024-09-21T07:32:53.332647+0000","last_became_peered":"2024-09-21T07:32:53.332647+0000","last_unstale":"2024-09-21T07:32:54.341493+0000","last_undegraded":"2024-09-21T07:32:54.341493+0000","last_fullsized":"2024-09-21T07:32:54.341493+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:29.678179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312357+0000","last_change":"2024-09-21T07:32:53.337814+0000","last_active":"2024-09-21T07:32:54.312357+0000","last_peered":"2024-09-21T07:32:54.312357+0000","last_clean":"2024-09-21T07:32:54.312357+0000","last_became_active":"2024-09-21T07:32:53.337401+0000","last_became_peered":"2024-09-21T07:32:53.337401+0000","last_unstale":"2024-09-21T07:32:54.312357+0000","last_undegraded":"2024-09-21T07:32:54.312357+0000","last_fullsized":"2024-09-21T07:32:54.312357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:33.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333057+0000","last_change":"2024-09-21T07:32:53.329954+0000","last_active":"2024-09-21T07:32:54.333057+0000","last_peered":"2024-09-21T07:32:54.333057+0000","last_clean":"2024-09-21T07:32:54.333057+0000","last_became_active":"2024-09-21T07:32:53.329593+0000","last_became_peered":"2024-09-21T07:32:53.329593+0000","last_unstale":"2024-09-21T07:32:54.333057+0000","last_undegraded":"2024-09-21T07:32:54.333057+0000","last_fullsized":"2024-09-21T07:32:54.333057+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:12.032893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:16.407790+0000","last_change":"2024-09-21T07:32:51.321304+0000","last_active":"2024-09-21T07:33:16.407790+0000","last_peered":"2024-09-21T07:33:16.407790+0000","last_clean":"2024-09-21T07:33:16.407790+0000","last_became_active":"2024-09-21T07:32:51.320586+0000","last_became_peered":"2024-09-21T07:32:51.320586+0000","last_unstale":"2024-09-21T07:33:16.407790+0000","last_undegraded":"2024-09-21T07:33:16.407790+0000","last_fullsized":"2024-09-21T07:33:16.407790+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:20.533367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342555+0000","last_change":"2024-09-21T07:32:53.340005+0000","last_active":"2024-09-21T07:32:54.342555+0000","last_peered":"2024-09-21T07:32:54.342555+0000","last_clean":"2024-09-21T07:32:54.342555+0000","last_became_active":"2024-09-21T07:32:53.339433+0000","last_became_peered":"2024-09-21T07:32:53.339433+0000","last_unstale":"2024-09-21T07:32:54.342555+0000","last_undegraded":"2024-09-21T07:32:54.342555+0000","last_fullsized":"2024-09-21T07:32:54.342555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:16.469652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377622+0000","last_change":"2024-09-21T07:32:51.320218+0000","last_active":"2024-09-21T07:33:02.377622+0000","last_peered":"2024-09-21T07:33:02.377622+0000","last_clean":"2024-09-21T07:33:02.377622+0000","last_became_active":"2024-09-21T07:32:51.319793+0000","last_became_peered":"2024-09-21T07:32:51.319793+0000","last_unstale":"2024-09-21T07:33:02.377622+0000","last_undegraded":"2024-09-21T07:33:02.377622+0000","last_fullsized":"2024-09-21T07:33:02.377622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.839505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.375609+0000","last_change":"2024-09-21T07:32:51.313478+0000","last_active":"2024-09-21T07:33:02.375609+0000","last_peered":"2024-09-21T07:33:02.375609+0000","last_clean":"2024-09-21T07:33:02.375609+0000","last_became_active":"2024-09-21T07:32:51.313112+0000","last_became_peered":"2024-09-21T07:32:51.313112+0000","last_unstale":"2024-09-21T07:33:02.375609+0000","last_undegraded":"2024-09-21T07:33:02.375609+0000","last_fullsized":"2024-09-21T07:33:02.375609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.064888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340070+0000","last_change":"2024-09-21T07:32:53.322252+0000","last_active":"2024-09-21T07:32:54.340070+0000","last_peered":"2024-09-21T07:32:54.340070+0000","last_clean":"2024-09-21T07:32:54.340070+0000","last_became_active":"2024-09-21T07:32:53.321919+0000","last_became_peered":"2024-09-21T07:32:53.321919+0000","last_unstale":"2024-09-21T07:32:54.340070+0000","last_undegraded":"2024-09-21T07:32:54.340070+0000","last_fullsized":"2024-09-21T07:32:54.340070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:15.852678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.345257+0000","last_change":"2024-09-21T07:32:51.322190+0000","last_active":"2024-09-21T07:32:54.345257+0000","last_peered":"2024-09-21T07:32:54.345257+0000","last_clean":"2024-09-21T07:32:54.345257+0000","last_became_active":"2024-09-21T07:32:51.321307+0000","last_became_peered":"2024-09-21T07:32:51.321307+0000","last_unstale":"2024-09-21T07:32:54.345257+0000","last_undegraded":"2024-09-21T07:32:54.345257+0000","last_fullsized":"2024-09-21T07:32:54.345257+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:23.029068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.338883+0000","last_change":"2024-09-21T07:32:53.323650+0000","last_active":"2024-09-21T07:32:54.338883+0000","last_peered":"2024-09-21T07:32:54.338883+0000","last_clean":"2024-09-21T07:32:54.338883+0000","last_became_active":"2024-09-21T07:32:53.323304+0000","last_became_peered":"2024-09-21T07:32:53.323304+0000","last_unstale":"2024-09-21T07:32:54.338883+0000","last_undegraded":"2024-09-21T07:32:54.338883+0000","last_fullsized":"2024-09-21T07:32:54.338883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.229852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:15.405460+0000","last_change":"2024-09-21T07:32:51.319021+0000","last_active":"2024-09-21T07:33:15.405460+0000","last_peered":"2024-09-21T07:33:15.405460+0000","last_clean":"2024-09-21T07:33:15.405460+0000","last_became_active":"2024-09-21T07:32:51.318150+0000","last_became_peered":"2024-09-21T07:32:51.318150+0000","last_unstale":"2024-09-21T07:33:15.405460+0000","last_undegraded":"2024-09-21T07:33:15.405460+0000","last_fullsized":"2024-09-21T07:33:15.405460+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.408401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342713+0000","last_change":"2024-09-21T07:32:53.327203+0000","last_active":"2024-09-21T07:32:54.342713+0000","last_peered":"2024-09-21T07:32:54.342713+0000","last_clean":"2024-09-21T07:32:54.342713+0000","last_became_active":"2024-09-21T07:32:53.326784+0000","last_became_peered":"2024-09-21T07:32:53.326784+0000","last_unstale":"2024-09-21T07:32:54.342713+0000","last_undegraded":"2024-09-21T07:32:54.342713+0000","last_fullsized":"2024-09-21T07:32:54.342713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.468948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.372911+0000","last_change":"2024-09-21T07:32:51.314749+0000","last_active":"2024-09-21T07:33:01.372911+0000","last_peered":"2024-09-21T07:33:01.372911+0000","last_clean":"2024-09-21T07:33:01.372911+0000","last_became_active":"2024-09-21T07:32:51.314181+0000","last_became_peered":"2024-09-21T07:32:51.314181+0000","last_unstale":"2024-09-21T07:33:01.372911+0000","last_undegraded":"2024-09-21T07:33:01.372911+0000","last_fullsized":"2024-09-21T07:33:01.372911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:22.541053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344073+0000","last_change":"2024-09-21T07:32:53.334410+0000","last_active":"2024-09-21T07:32:54.344073+0000","last_peered":"2024-09-21T07:32:54.344073+0000","last_clean":"2024-09-21T07:32:54.344073+0000","last_became_active":"2024-09-21T07:32:53.334000+0000","last_became_peered":"2024-09-21T07:32:53.334000+0000","last_unstale":"2024-09-21T07:32:54.344073+0000","last_undegraded":"2024-09-21T07:32:54.344073+0000","last_fullsized":"2024-09-21T07:32:54.344073+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:11.316706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.371203+0000","last_change":"2024-09-21T07:32:51.959823+0000","last_active":"2024-09-21T07:33:01.371203+0000","last_peered":"2024-09-21T07:33:01.371203+0000","last_clean":"2024-09-21T07:33:01.371203+0000","last_became_active":"2024-09-21T07:32:51.959435+0000","last_became_peered":"2024-09-21T07:32:51.959435+0000","last_unstale":"2024-09-21T07:33:01.371203+0000","last_undegraded":"2024-09-21T07:33:01.371203+0000","last_fullsized":"2024-09-21T07:33:01.371203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:46.394422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342258+0000","last_change":"2024-09-21T07:32:53.334201+0000","last_active":"2024-09-21T07:32:54.342258+0000","last_peered":"2024-09-21T07:32:54.342258+0000","last_clean":"2024-09-21T07:32:54.342258+0000","last_became_active":"2024-09-21T07:32:53.333815+0000","last_became_peered":"2024-09-21T07:32:53.333815+0000","last_unstale":"2024-09-21T07:32:54.342258+0000","last_undegraded":"2024-09-21T07:32:54.342258+0000","last_fullsized":"2024-09-21T07:32:54.342258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:48.783373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'25","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:16.407411+0000","last_change":"2024-09-21T07:32:51.318963+0000","last_active":"2024-09-21T07:33:16.407411+0000","last_peered":"2024-09-21T07:33:16.407411+0000","last_clean":"2024-09-21T07:33:16.407411+0000","last_became_active":"2024-09-21T07:32:51.318560+0000","last_became_peered":"2024-09-21T07:32:51.318560+0000","last_unstale":"2024-09-21T07:33:16.407411+0000","last_undegraded":"2024-09-21T07:33:16.407411+0000","last_fullsized":"2024-09-21T07:33:16.407411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:27.049827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54250,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":69,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333809+0000","last_change":"2024-09-21T07:32:53.326999+0000","last_active":"2024-09-21T07:32:54.333809+0000","last_peered":"2024-09-21T07:32:54.333809+0000","last_clean":"2024-09-21T07:32:54.333809+0000","last_became_active":"2024-09-21T07:32:53.326550+0000","last_became_peered":"2024-09-21T07:32:53.326550+0000","last_unstale":"2024-09-21T07:32:54.333809+0000","last_undegraded":"2024-09-21T07:32:54.333809+0000","last_fullsized":"2024-09-21T07:32:54.333809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:12.036977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377464+0000","last_change":"2024-09-21T07:32:51.317687+0000","last_active":"2024-09-21T07:33:02.377464+0000","last_peered":"2024-09-21T07:33:02.377464+0000","last_clean":"2024-09-21T07:33:02.377464+0000","last_became_active":"2024-09-21T07:32:51.316986+0000","last_became_peered":"2024-09-21T07:32:51.316986+0000","last_unstale":"2024-09-21T07:33:02.377464+0000","last_undegraded":"2024-09-21T07:33:02.377464+0000","last_fullsized":"2024-09-21T07:33:02.377464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:39.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.311773+0000","last_change":"2024-09-21T07:32:53.323562+0000","last_active":"2024-09-21T07:32:54.311773+0000","last_peered":"2024-09-21T07:32:54.311773+0000","last_clean":"2024-09-21T07:32:54.311773+0000","last_became_active":"2024-09-21T07:32:53.323106+0000","last_became_peered":"2024-09-21T07:32:53.323106+0000","last_unstale":"2024-09-21T07:32:54.311773+0000","last_undegraded":"2024-09-21T07:32:54.311773+0000","last_fullsized":"2024-09-21T07:32:54.311773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:24.607014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.373033+0000","last_change":"2024-09-21T07:32:51.320887+0000","last_active":"2024-09-21T07:33:01.373033+0000","last_peered":"2024-09-21T07:33:01.373033+0000","last_clean":"2024-09-21T07:33:01.373033+0000","last_became_active":"2024-09-21T07:32:51.319706+0000","last_became_peered":"2024-09-21T07:32:51.319706+0000","last_unstale":"2024-09-21T07:33:01.373033+0000","last_undegraded":"2024-09-21T07:33:01.373033+0000","last_fullsized":"2024-09-21T07:33:01.373033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:49.594900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344751+0000","last_change":"2024-09-21T07:32:53.330353+0000","last_active":"2024-09-21T07:32:54.344751+0000","last_peered":"2024-09-21T07:32:54.344751+0000","last_clean":"2024-09-21T07:32:54.344751+0000","last_became_active":"2024-09-21T07:32:53.329871+0000","last_became_peered":"2024-09-21T07:32:53.329871+0000","last_unstale":"2024-09-21T07:32:54.344751+0000","last_undegraded":"2024-09-21T07:32:54.344751+0000","last_fullsized":"2024-09-21T07:32:54.344751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:59.075562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:15.406850+0000","last_change":"2024-09-21T07:32:51.319604+0000","last_active":"2024-09-21T07:33:15.406850+0000","last_peered":"2024-09-21T07:33:15.406850+0000","last_clean":"2024-09-21T07:33:15.406850+0000","last_became_active":"2024-09-21T07:32:51.319226+0000","last_became_peered":"2024-09-21T07:32:51.319226+0000","last_unstale":"2024-09-21T07:33:15.406850+0000","last_undegraded":"2024-09-21T07:33:15.406850+0000","last_fullsized":"2024-09-21T07:33:15.406850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:21.724229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343555+0000","last_change":"2024-09-21T07:32:53.332607+0000","last_active":"2024-09-21T07:32:54.343555+0000","last_peered":"2024-09-21T07:32:54.343555+0000","last_clean":"2024-09-21T07:32:54.343555+0000","last_became_active":"2024-09-21T07:32:53.332272+0000","last_became_peered":"2024-09-21T07:32:53.332272+0000","last_unstale":"2024-09-21T07:32:54.343555+0000","last_undegraded":"2024-09-21T07:32:54.343555+0000","last_fullsized":"2024-09-21T07:32:54.343555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:57.193207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.378137+0000","last_change":"2024-09-21T07:32:51.959693+0000","last_active":"2024-09-21T07:33:02.378137+0000","last_peered":"2024-09-21T07:33:02.378137+0000","last_clean":"2024-09-21T07:33:02.378137+0000","last_became_active":"2024-09-21T07:32:51.959276+0000","last_became_peered":"2024-09-21T07:32:51.959276+0000","last_unstale":"2024-09-21T07:33:02.378137+0000","last_undegraded":"2024-09-21T07:33:02.378137+0000","last_fullsized":"2024-09-21T07:33:02.378137+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:05.808530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342122+0000","last_change":"2024-09-21T07:32:53.340603+0000","last_active":"2024-09-21T07:32:54.342122+0000","last_peered":"2024-09-21T07:32:54.342122+0000","last_clean":"2024-09-21T07:32:54.342122+0000","last_became_active":"2024-09-21T07:32:53.339451+0000","last_became_peered":"2024-09-21T07:32:53.339451+0000","last_unstale":"2024-09-21T07:32:54.342122+0000","last_undegraded":"2024-09-21T07:32:54.342122+0000","last_fullsized":"2024-09-21T07:32:54.342122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:50.895945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:03.382289+0000","last_change":"2024-09-21T07:32:51.321912+0000","last_active":"2024-09-21T07:33:03.382289+0000","last_peered":"2024-09-21T07:33:03.382289+0000","last_clean":"2024-09-21T07:33:03.382289+0000","last_became_active":"2024-09-21T07:32:51.320880+0000","last_became_peered":"2024-09-21T07:32:51.320880+0000","last_unstale":"2024-09-21T07:33:03.382289+0000","last_undegraded":"2024-09-21T07:33:03.382289+0000","last_fullsized":"2024-09-21T07:33:03.382289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:05.538597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312603+0000","last_change":"2024-09-21T07:32:53.332894+0000","last_active":"2024-09-21T07:32:54.312603+0000","last_peered":"2024-09-21T07:32:54.312603+0000","last_clean":"2024-09-21T07:32:54.312603+0000","last_became_active":"2024-09-21T07:32:53.332489+0000","last_became_peered":"2024-09-21T07:32:53.332489+0000","last_unstale":"2024-09-21T07:32:54.312603+0000","last_undegraded":"2024-09-21T07:32:54.312603+0000","last_fullsized":"2024-09-21T07:32:54.312603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:18.312560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339604+0000","last_change":"2024-09-21T07:32:51.313363+0000","last_active":"2024-09-21T07:32:54.339604+0000","last_peered":"2024-09-21T07:32:54.339604+0000","last_clean":"2024-09-21T07:32:54.339604+0000","last_became_active":"2024-09-21T07:32:51.313001+0000","last_became_peered":"2024-09-21T07:32:51.313001+0000","last_unstale":"2024-09-21T07:32:54.339604+0000","last_undegraded":"2024-09-21T07:32:54.339604+0000","last_fullsized":"2024-09-21T07:32:54.339604+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:58.056561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343719+0000","last_change":"2024-09-21T07:32:53.325791+0000","last_active":"2024-09-21T07:32:54.343719+0000","last_peered":"2024-09-21T07:32:54.343719+0000","last_clean":"2024-09-21T07:32:54.343719+0000","last_became_active":"2024-09-21T07:32:53.325406+0000","last_became_peered":"2024-09-21T07:32:53.325406+0000","last_unstale":"2024-09-21T07:32:54.343719+0000","last_undegraded":"2024-09-21T07:32:54.343719+0000","last_fullsized":"2024-09-21T07:32:54.343719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.915438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.347609+0000","last_change":"2024-09-21T07:32:51.318862+0000","last_active":"2024-09-21T07:32:54.347609+0000","last_peered":"2024-09-21T07:32:54.347609+0000","last_clean":"2024-09-21T07:32:54.347609+0000","last_became_active":"2024-09-21T07:32:51.318423+0000","last_became_peered":"2024-09-21T07:32:51.318423+0000","last_unstale":"2024-09-21T07:32:54.347609+0000","last_undegraded":"2024-09-21T07:32:54.347609+0000","last_fullsized":"2024-09-21T07:32:54.347609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:57.438214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344410+0000","last_change":"2024-09-21T07:32:53.333475+0000","last_active":"2024-09-21T07:32:54.344410+0000","last_peered":"2024-09-21T07:32:54.344410+0000","last_clean":"2024-09-21T07:32:54.344410+0000","last_became_active":"2024-09-21T07:32:53.333039+0000","last_became_peered":"2024-09-21T07:32:53.333039+0000","last_unstale":"2024-09-21T07:32:54.344410+0000","last_undegraded":"2024-09-21T07:32:54.344410+0000","last_fullsized":"2024-09-21T07:32:54.344410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:39.510813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377220+0000","last_change":"2024-09-21T07:32:51.958898+0000","last_active":"2024-09-21T07:33:02.377220+0000","last_peered":"2024-09-21T07:33:02.377220+0000","last_clean":"2024-09-21T07:33:02.377220+0000","last_became_active":"2024-09-21T07:32:51.958411+0000","last_became_peered":"2024-09-21T07:32:51.958411+0000","last_unstale":"2024-09-21T07:33:02.377220+0000","last_undegraded":"2024-09-21T07:33:02.377220+0000","last_fullsized":"2024-09-21T07:33:02.377220+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:12.375874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344882+0000","last_change":"2024-09-21T07:32:53.331327+0000","last_active":"2024-09-21T07:32:54.344882+0000","last_peered":"2024-09-21T07:32:54.344882+0000","last_clean":"2024-09-21T07:32:54.344882+0000","last_became_active":"2024-09-21T07:32:53.329449+0000","last_became_peered":"2024-09-21T07:32:53.329449+0000","last_unstale":"2024-09-21T07:32:54.344882+0000","last_undegraded":"2024-09-21T07:32:54.344882+0000","last_fullsized":"2024-09-21T07:32:54.344882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:20.605458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":91,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344103+0000","last_change":"2024-09-21T07:31:42.854046+0000","last_active":"2024-09-21T07:32:54.344103+0000","last_peered":"2024-09-21T07:32:54.344103+0000","last_clean":"2024-09-21T07:32:54.344103+0000","last_became_active":"2024-09-21T07:31:42.847659+0000","last_became_peered":"2024-09-21T07:31:42.847659+0000","last_unstale":"2024-09-21T07:32:54.344103+0000","last_undegraded":"2024-09-21T07:32:54.344103+0000","last_fullsized":"2024-09-21T07:32:54.344103+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_clean_scrub_stamp":"2024-09-21T07:28:23.379848+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:17.782511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:03.385079+0000","last_change":"2024-09-21T07:32:51.316842+0000","last_active":"2024-09-21T07:33:03.385079+0000","last_peered":"2024-09-21T07:33:03.385079+0000","last_clean":"2024-09-21T07:33:03.385079+0000","last_became_active":"2024-09-21T07:32:51.316409+0000","last_became_peered":"2024-09-21T07:32:51.316409+0000","last_unstale":"2024-09-21T07:33:03.385079+0000","last_undegraded":"2024-09-21T07:33:03.385079+0000","last_fullsized":"2024-09-21T07:33:03.385079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.648952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339873+0000","last_change":"2024-09-21T07:32:53.331632+0000","last_active":"2024-09-21T07:32:54.339873+0000","last_peered":"2024-09-21T07:32:54.339873+0000","last_clean":"2024-09-21T07:32:54.339873+0000","last_became_active":"2024-09-21T07:32:53.331071+0000","last_became_peered":"2024-09-21T07:32:53.331071+0000","last_unstale":"2024-09-21T07:32:54.339873+0000","last_undegraded":"2024-09-21T07:32:54.339873+0000","last_fullsized":"2024-09-21T07:32:54.339873+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:41.568187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377515+0000","last_change":"2024-09-21T07:32:51.319580+0000","last_active":"2024-09-21T07:33:02.377515+0000","last_peered":"2024-09-21T07:33:02.377515+0000","last_clean":"2024-09-21T07:33:02.377515+0000","last_became_active":"2024-09-21T07:32:51.319199+0000","last_became_peered":"2024-09-21T07:32:51.319199+0000","last_unstale":"2024-09-21T07:33:02.377515+0000","last_undegraded":"2024-09-21T07:33:02.377515+0000","last_fullsized":"2024-09-21T07:33:02.377515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.851480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.311682+0000","last_change":"2024-09-21T07:32:53.330969+0000","last_active":"2024-09-21T07:32:54.311682+0000","last_peered":"2024-09-21T07:32:54.311682+0000","last_clean":"2024-09-21T07:32:54.311682+0000","last_became_active":"2024-09-21T07:32:53.329772+0000","last_became_peered":"2024-09-21T07:32:53.329772+0000","last_unstale":"2024-09-21T07:32:54.311682+0000","last_undegraded":"2024-09-21T07:32:54.311682+0000","last_fullsized":"2024-09-21T07:32:54.311682+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:23.790114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":37,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:15.406323+0000","last_change":"2024-09-21T07:32:51.958596+0000","last_active":"2024-09-21T07:33:15.406323+0000","last_peered":"2024-09-21T07:33:15.406323+0000","last_clean":"2024-09-21T07:33:15.406323+0000","last_became_active":"2024-09-21T07:32:51.958140+0000","last_became_peered":"2024-09-21T07:32:51.958140+0000","last_unstale":"2024-09-21T07:33:15.406323+0000","last_undegraded":"2024-09-21T07:33:15.406323+0000","last_fullsized":"2024-09-21T07:33:15.406323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:43.697003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344454+0000","last_change":"2024-09-21T07:32:53.340627+0000","last_active":"2024-09-21T07:32:54.344454+0000","last_peered":"2024-09-21T07:32:54.344454+0000","last_clean":"2024-09-21T07:32:54.344454+0000","last_became_active":"2024-09-21T07:32:53.340095+0000","last_became_peered":"2024-09-21T07:32:53.340095+0000","last_unstale":"2024-09-21T07:32:54.344454+0000","last_undegraded":"2024-09-21T07:32:54.344454+0000","last_fullsized":"2024-09-21T07:32:54.344454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:55.053809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344651+0000","last_change":"2024-09-21T07:32:51.316441+0000","last_active":"2024-09-21T07:32:54.344651+0000","last_peered":"2024-09-21T07:32:54.344651+0000","last_clean":"2024-09-21T07:32:54.344651+0000","last_became_active":"2024-09-21T07:32:51.315920+0000","last_became_peered":"2024-09-21T07:32:51.315920+0000","last_unstale":"2024-09-21T07:32:54.344651+0000","last_undegraded":"2024-09-21T07:32:54.344651+0000","last_fullsized":"2024-09-21T07:32:54.344651+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:06.459155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.315368+0000","last_change":"2024-09-21T07:32:53.338859+0000","last_active":"2024-09-21T07:32:54.315368+0000","last_peered":"2024-09-21T07:32:54.315368+0000","last_clean":"2024-09-21T07:32:54.315368+0000","last_became_active":"2024-09-21T07:32:53.338332+0000","last_became_peered":"2024-09-21T07:32:53.338332+0000","last_unstale":"2024-09-21T07:32:54.315368+0000","last_undegraded":"2024-09-21T07:32:54.315368+0000","last_fullsized":"2024-09-21T07:32:54.315368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.852758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.339097+0000","last_change":"2024-09-21T07:32:51.959081+0000","last_active":"2024-09-21T07:32:54.339097+0000","last_peered":"2024-09-21T07:32:54.339097+0000","last_clean":"2024-09-21T07:32:54.339097+0000","last_became_active":"2024-09-21T07:32:51.958701+0000","last_became_peered":"2024-09-21T07:32:51.958701+0000","last_unstale":"2024-09-21T07:32:54.339097+0000","last_undegraded":"2024-09-21T07:32:54.339097+0000","last_fullsized":"2024-09-21T07:32:54.339097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:56.216119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:56.466649+0000","last_change":"2024-09-21T07:32:53.328300+0000","last_active":"2024-09-21T07:32:56.466649+0000","last_peered":"2024-09-21T07:32:56.466649+0000","last_clean":"2024-09-21T07:32:56.466649+0000","last_became_active":"2024-09-21T07:32:53.327485+0000","last_became_peered":"2024-09-21T07:32:53.327485+0000","last_unstale":"2024-09-21T07:32:56.466649+0000","last_undegraded":"2024-09-21T07:32:56.466649+0000","last_fullsized":"2024-09-21T07:32:56.466649+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:46.958341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.370568+0000","last_change":"2024-09-21T07:32:51.958430+0000","last_active":"2024-09-21T07:33:01.370568+0000","last_peered":"2024-09-21T07:33:01.370568+0000","last_clean":"2024-09-21T07:33:01.370568+0000","last_became_active":"2024-09-21T07:32:51.957884+0000","last_became_peered":"2024-09-21T07:32:51.957884+0000","last_unstale":"2024-09-21T07:33:01.370568+0000","last_undegraded":"2024-09-21T07:33:01.370568+0000","last_fullsized":"2024-09-21T07:33:01.370568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:31.116439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312293+0000","last_change":"2024-09-21T07:32:53.316991+0000","last_active":"2024-09-21T07:32:54.312293+0000","last_peered":"2024-09-21T07:32:54.312293+0000","last_clean":"2024-09-21T07:32:54.312293+0000","last_became_active":"2024-09-21T07:32:53.316588+0000","last_became_peered":"2024-09-21T07:32:53.316588+0000","last_unstale":"2024-09-21T07:32:54.312293+0000","last_undegraded":"2024-09-21T07:32:54.312293+0000","last_fullsized":"2024-09-21T07:32:54.312293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:04.766114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'8","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:14.339525+0000","last_change":"2024-09-21T07:32:51.317544+0000","last_active":"2024-09-21T07:33:14.339525+0000","last_peered":"2024-09-21T07:33:14.339525+0000","last_clean":"2024-09-21T07:33:14.339525+0000","last_became_active":"2024-09-21T07:32:51.317091+0000","last_became_peered":"2024-09-21T07:32:51.317091+0000","last_unstale":"2024-09-21T07:33:14.339525+0000","last_undegraded":"2024-09-21T07:33:14.339525+0000","last_fullsized":"2024-09-21T07:33:14.339525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:25.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340691+0000","last_change":"2024-09-21T07:32:53.328118+0000","last_active":"2024-09-21T07:32:54.340691+0000","last_peered":"2024-09-21T07:32:54.340691+0000","last_clean":"2024-09-21T07:32:54.340691+0000","last_became_active":"2024-09-21T07:32:53.327755+0000","last_became_peered":"2024-09-21T07:32:53.327755+0000","last_unstale":"2024-09-21T07:32:54.340691+0000","last_undegraded":"2024-09-21T07:32:54.340691+0000","last_fullsized":"2024-09-21T07:32:54.340691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:00.655258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.370551+0000","last_change":"2024-09-21T07:32:51.566524+0000","last_active":"2024-09-21T07:33:01.370551+0000","last_peered":"2024-09-21T07:33:01.370551+0000","last_clean":"2024-09-21T07:33:01.370551+0000","last_became_active":"2024-09-21T07:32:51.566115+0000","last_became_peered":"2024-09-21T07:32:51.566115+0000","last_unstale":"2024-09-21T07:33:01.370551+0000","last_undegraded":"2024-09-21T07:33:01.370551+0000","last_fullsized":"2024-09-21T07:33:01.370551+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:01.098512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343521+0000","last_change":"2024-09-21T07:32:53.334275+0000","last_active":"2024-09-21T07:32:54.343521+0000","last_peered":"2024-09-21T07:32:54.343521+0000","last_clean":"2024-09-21T07:32:54.343521+0000","last_became_active":"2024-09-21T07:32:53.333842+0000","last_became_peered":"2024-09-21T07:32:53.333842+0000","last_unstale":"2024-09-21T07:32:54.343521+0000","last_undegraded":"2024-09-21T07:32:54.343521+0000","last_fullsized":"2024-09-21T07:32:54.343521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:21.370325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.368819+0000","last_change":"2024-09-21T07:32:51.959211+0000","last_active":"2024-09-21T07:33:01.368819+0000","last_peered":"2024-09-21T07:33:01.368819+0000","last_clean":"2024-09-21T07:33:01.368819+0000","last_became_active":"2024-09-21T07:32:51.958887+0000","last_became_peered":"2024-09-21T07:32:51.958887+0000","last_unstale":"2024-09-21T07:33:01.368819+0000","last_undegraded":"2024-09-21T07:33:01.368819+0000","last_fullsized":"2024-09-21T07:33:01.368819+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:22.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.333080+0000","last_change":"2024-09-21T07:32:53.323125+0000","last_active":"2024-09-21T07:32:54.333080+0000","last_peered":"2024-09-21T07:32:54.333080+0000","last_clean":"2024-09-21T07:32:54.333080+0000","last_became_active":"2024-09-21T07:32:53.322746+0000","last_became_peered":"2024-09-21T07:32:53.322746+0000","last_unstale":"2024-09-21T07:32:54.333080+0000","last_undegraded":"2024-09-21T07:32:54.333080+0000","last_fullsized":"2024-09-21T07:32:54.333080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:53.957518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.371726+0000","last_change":"2024-09-21T07:32:51.314786+0000","last_active":"2024-09-21T07:33:01.371726+0000","last_peered":"2024-09-21T07:33:01.371726+0000","last_clean":"2024-09-21T07:33:01.371726+0000","last_became_active":"2024-09-21T07:32:51.314436+0000","last_became_peered":"2024-09-21T07:32:51.314436+0000","last_unstale":"2024-09-21T07:33:01.371726+0000","last_undegraded":"2024-09-21T07:33:01.371726+0000","last_fullsized":"2024-09-21T07:33:01.371726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:39.672746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.312691+0000","last_change":"2024-09-21T07:32:53.332759+0000","last_active":"2024-09-21T07:32:54.312691+0000","last_peered":"2024-09-21T07:32:54.312691+0000","last_clean":"2024-09-21T07:32:54.312691+0000","last_became_active":"2024-09-21T07:32:53.332353+0000","last_became_peered":"2024-09-21T07:32:53.332353+0000","last_unstale":"2024-09-21T07:32:54.312691+0000","last_undegraded":"2024-09-21T07:32:54.312691+0000","last_fullsized":"2024-09-21T07:32:54.312691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:22.561528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.342280+0000","last_change":"2024-09-21T07:32:51.318180+0000","last_active":"2024-09-21T07:32:54.342280+0000","last_peered":"2024-09-21T07:32:54.342280+0000","last_clean":"2024-09-21T07:32:54.342280+0000","last_became_active":"2024-09-21T07:32:51.317630+0000","last_became_peered":"2024-09-21T07:32:51.317630+0000","last_unstale":"2024-09-21T07:32:54.342280+0000","last_undegraded":"2024-09-21T07:32:54.342280+0000","last_fullsized":"2024-09-21T07:32:54.342280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.976579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.340823+0000","last_change":"2024-09-21T07:32:53.326166+0000","last_active":"2024-09-21T07:32:54.340823+0000","last_peered":"2024-09-21T07:32:54.340823+0000","last_clean":"2024-09-21T07:32:54.340823+0000","last_became_active":"2024-09-21T07:32:53.325797+0000","last_became_peered":"2024-09-21T07:32:53.325797+0000","last_unstale":"2024-09-21T07:32:54.340823+0000","last_undegraded":"2024-09-21T07:32:54.340823+0000","last_fullsized":"2024-09-21T07:32:54.340823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:43.130088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:01.371972+0000","last_change":"2024-09-21T07:32:51.323554+0000","last_active":"2024-09-21T07:33:01.371972+0000","last_peered":"2024-09-21T07:33:01.371972+0000","last_clean":"2024-09-21T07:33:01.371972+0000","last_became_active":"2024-09-21T07:32:51.322847+0000","last_became_peered":"2024-09-21T07:32:51.322847+0000","last_unstale":"2024-09-21T07:33:01.371972+0000","last_undegraded":"2024-09-21T07:33:01.371972+0000","last_fullsized":"2024-09-21T07:33:01.371972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:23.102513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344229+0000","last_change":"2024-09-21T07:32:53.330124+0000","last_active":"2024-09-21T07:32:54.344229+0000","last_peered":"2024-09-21T07:32:54.344229+0000","last_clean":"2024-09-21T07:32:54.344229+0000","last_became_active":"2024-09-21T07:32:53.329497+0000","last_became_peered":"2024-09-21T07:32:53.329497+0000","last_unstale":"2024-09-21T07:32:54.344229+0000","last_undegraded":"2024-09-21T07:32:54.344229+0000","last_fullsized":"2024-09-21T07:32:54.344229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:40.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343756+0000","last_change":"2024-09-21T07:32:53.340492+0000","last_active":"2024-09-21T07:32:54.343756+0000","last_peered":"2024-09-21T07:32:54.343756+0000","last_clean":"2024-09-21T07:32:54.343756+0000","last_became_active":"2024-09-21T07:32:53.339535+0000","last_became_peered":"2024-09-21T07:32:53.339535+0000","last_unstale":"2024-09-21T07:32:54.343756+0000","last_undegraded":"2024-09-21T07:32:54.343756+0000","last_fullsized":"2024-09-21T07:32:54.343756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:01.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.344473+0000","last_change":"2024-09-21T07:32:51.321423+0000","last_active":"2024-09-21T07:32:54.344473+0000","last_peered":"2024-09-21T07:32:54.344473+0000","last_clean":"2024-09-21T07:32:54.344473+0000","last_became_active":"2024-09-21T07:32:51.320844+0000","last_became_peered":"2024-09-21T07:32:51.320844+0000","last_unstale":"2024-09-21T07:32:54.344473+0000","last_undegraded":"2024-09-21T07:32:54.344473+0000","last_fullsized":"2024-09-21T07:32:54.344473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.771991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.341509+0000","last_change":"2024-09-21T07:32:53.337661+0000","last_active":"2024-09-21T07:32:54.341509+0000","last_peered":"2024-09-21T07:32:54.341509+0000","last_clean":"2024-09-21T07:32:54.341509+0000","last_became_active":"2024-09-21T07:32:53.337269+0000","last_became_peered":"2024-09-21T07:32:53.337269+0000","last_unstale":"2024-09-21T07:32:54.341509+0000","last_undegraded":"2024-09-21T07:32:54.341509+0000","last_fullsized":"2024-09-21T07:32:54.341509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:31.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.377696+0000","last_change":"2024-09-21T07:32:51.323429+0000","last_active":"2024-09-21T07:33:02.377696+0000","last_peered":"2024-09-21T07:33:02.377696+0000","last_clean":"2024-09-21T07:33:02.377696+0000","last_became_active":"2024-09-21T07:32:51.323037+0000","last_became_peered":"2024-09-21T07:32:51.323037+0000","last_unstale":"2024-09-21T07:33:02.377696+0000","last_undegraded":"2024-09-21T07:33:02.377696+0000","last_fullsized":"2024-09-21T07:33:02.377696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:38.797479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.343867+0000","last_change":"2024-09-21T07:32:53.327544+0000","last_active":"2024-09-21T07:32:54.343867+0000","last_peered":"2024-09-21T07:32:54.343867+0000","last_clean":"2024-09-21T07:32:54.343867+0000","last_became_active":"2024-09-21T07:32:53.326960+0000","last_became_peered":"2024-09-21T07:32:53.326960+0000","last_unstale":"2024-09-21T07:32:54.343867+0000","last_undegraded":"2024-09-21T07:32:54.343867+0000","last_fullsized":"2024-09-21T07:32:54.343867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:47.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.346110+0000","last_change":"2024-09-21T07:32:51.959814+0000","last_active":"2024-09-21T07:32:54.346110+0000","last_peered":"2024-09-21T07:32:54.346110+0000","last_clean":"2024-09-21T07:32:54.346110+0000","last_became_active":"2024-09-21T07:32:51.957948+0000","last_became_peered":"2024-09-21T07:32:51.957948+0000","last_unstale":"2024-09-21T07:32:54.346110+0000","last_undegraded":"2024-09-21T07:32:54.346110+0000","last_fullsized":"2024-09-21T07:32:54.346110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:34.949022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:32:54.341670+0000","last_change":"2024-09-21T07:32:53.328689+0000","last_active":"2024-09-21T07:32:54.341670+0000","last_peered":"2024-09-21T07:32:54.341670+0000","last_clean":"2024-09-21T07:32:54.341670+0000","last_became_active":"2024-09-21T07:32:53.328340+0000","last_became_peered":"2024-09-21T07:32:53.328340+0000","last_unstale":"2024-09-21T07:32:54.341670+0000","last_undegraded":"2024-09-21T07:32:54.341670+0000","last_fullsized":"2024-09-21T07:32:54.341670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:11.294632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:33:02.378416+0000","last_change":"2024-09-21T07:32:51.317674+0000","last_active":"2024-09-21T07:33:02.378416+0000","last_peered":"2024-09-21T07:33:02.378416+0000","last_clean":"2024-09-21T07:33:02.378416+0000","last_became_active":"2024-09-21T07:32:51.317097+0000","last_became_peered":"2024-09-21T07:32:51.317097+0000","last_unstale":"2024-09-21T07:33:02.378416+0000","last_undegraded":"2024-09-21T07:33:02.378416+0000","last_fullsized":"2024-09-21T07:33:02.378416+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.144187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58251,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":110,"num_read_kb":116,"num_write":154,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":174753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776146,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":794624,"data_stored":383415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":31914435},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1486848,"data_stored":1029537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":811008,"data_stored":383651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":811008,"data_stored":383571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495654,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32556,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712596,"statfs":{"total":95995035648,"available":95961698304,"internally_reserved":0,"allocated":1404928,"data_stored":975501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40284,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704868,"statfs":{"total":95995035648,"available":95953784832,"internally_reserved":0,"allocated":798720,"data_stored":383040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32568,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712584,"statfs":{"total":95995035648,"available":95961686016,"internally_reserved":0,"allocated":1417216,"data_stored":974794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":383868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":383351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":438433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607620,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":437083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":384311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:20.889 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:33:20.889 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:33:20.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:33:21.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:20 smithi187 ceph-mon[34367]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:33:21.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:20 smithi123 ceph-mon[34166]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:33:21.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:20 smithi060 ceph-mon[31244]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:33:21.146 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 -- 172.21.15.60:0/218447174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c108370 msgr2=0x7eff6c10a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 --2- 172.21.15.60:0/218447174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c108370 0x7eff6c10a880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7eff64009ca0 tx=0x7eff6402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 -- 172.21.15.60:0/218447174 shutdown_connections 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 --2- 172.21.15.60:0/218447174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c108370 0x7eff6c10a880 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 --2- 172.21.15.60:0/218447174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c105750 0x7eff6c107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 --2- 172.21.15.60:0/218447174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff6c102cf0 0x7eff6c105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 -- 172.21.15.60:0/218447174 >> 172.21.15.60:0/218447174 conn(0x7eff6c0fd730 msgr2=0x7eff6c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:21.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 -- 172.21.15.60:0/218447174 shutdown_connections 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.617+0000 7eff73641640 1 -- 172.21.15.60:0/218447174 wait complete. 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 Processor -- start 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 -- start start 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c102cf0 0x7eff6c199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 0x7eff6c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff6c108370 0x7eff6c19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c101ce0 con 0x7eff6c105750 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c101b60 con 0x7eff6c102cf0 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff73641640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c101e60 con 0x7eff6c108370 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff70bdc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 0x7eff6c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff70bdc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 0x7eff6c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37652/0 (socket says 172.21.15.60:37652) 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.618+0000 7eff70bdc640 1 -- 172.21.15.60:0/1630439500 learned_addr learned my addr 172.21.15.60:0/1630439500 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:21.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff713dd640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c102cf0 0x7eff6c199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff70bdc640 1 -- 172.21.15.60:0/1630439500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff6c108370 msgr2=0x7eff6c19b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff70bdc640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff6c108370 0x7eff6c19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff70bdc640 1 -- 172.21.15.60:0/1630439500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c102cf0 msgr2=0x7eff6c199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff70bdc640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c102cf0 0x7eff6c199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff70bdc640 1 -- 172.21.15.60:0/1630439500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c19b7f0 con 0x7eff6c105750 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff713dd640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c102cf0 0x7eff6c199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff70bdc640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 0x7eff6c19a4c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c920 tx=0x7eff5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c007c70 con 0x7eff6c105750 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff5c007e10 con 0x7eff6c105750 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c19bae0 con 0x7eff6c105750 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c018820 con 0x7eff6c105750 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.619+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6c1a2270 con 0x7eff6c105750 2024-09-21T07:33:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.620+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6c0ff250 con 0x7eff6c105750 2024-09-21T07:33:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.622+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7eff5c00f450 con 0x7eff6c105750 2024-09-21T07:33:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.623+0000 7eff627fc640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7eff580b6620 0x7eff580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.623+0000 7eff713dd640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7eff580b6620 0x7eff580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.623+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7eff5c0e7710 con 0x7eff6c105750 2024-09-21T07:33:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.624+0000 7eff713dd640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7eff580b6620 0x7eff580b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff6800baa0 tx=0x7eff68005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:21.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.627+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff5c014030 con 0x7eff6c105750 2024-09-21T07:33:21.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:21 smithi060 ceph-mon[31244]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-21T07:33:21.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.890+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7eff6c02e640 con 0x7eff6c105750 2024-09-21T07:33:21.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.893+0000 7eff627fc640 1 -- 172.21.15.60:0/1630439500 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7eff5c0ae100 con 0x7eff6c105750 2024-09-21T07:33:21.895 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-21T07:33:21.895 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDBdu5mm2QnNRAA4yF3OxW3sgkOUrY+P2+NaQ== 2024-09-21T07:33:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7eff580b6620 msgr2=0x7eff580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7eff580b6620 0x7eff580b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff6800baa0 tx=0x7eff68005d90 comp rx=0 tx=0).stop 2024-09-21T07:33:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 msgr2=0x7eff6c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 0x7eff6c19a4c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c920 tx=0x7eff5c00cde0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 shutdown_connections 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7eff580b6620 0x7eff580b8b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff6c108370 0x7eff6c19b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff6c105750 0x7eff6c19a4c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 --2- 172.21.15.60:0/1630439500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff6c102cf0 0x7eff6c199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.895+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 >> 172.21.15.60:0/1630439500 conn(0x7eff6c0fd730 msgr2=0x7eff6c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.896+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 shutdown_connections 2024-09-21T07:33:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:21.896+0000 7eff73641640 1 -- 172.21.15.60:0/1630439500 wait complete. 2024-09-21T07:33:22.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:21 smithi187 ceph-mon[34367]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-21T07:33:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:21 smithi123 ceph-mon[34166]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-21T07:33:22.580 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:33:22.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:33:22.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:33:22.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T07:33:22.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:22 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1630439500' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:33:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:22 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1630439500' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:33:22.922 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:23.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:22 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1630439500' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:33:23.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:22 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1630439500' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:33:23.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:22 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1630439500' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:33:23.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:22 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1630439500' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:33:23.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 -- 172.21.15.60:0/1407391294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e0109e10 msgr2=0x7f96e0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 --2- 172.21.15.60:0/1407391294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e0109e10 0x7f96e0110640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009900 tx=0x7f96d802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 -- 172.21.15.60:0/1407391294 shutdown_connections 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 --2- 172.21.15.60:0/1407391294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e0109e10 0x7f96e0110640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 --2- 172.21.15.60:0/1407391294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e01094c0 0x7f96e01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 --2- 172.21.15.60:0/1407391294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0103b80 0x7f96e0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 -- 172.21.15.60:0/1407391294 >> 172.21.15.60:0/1407391294 conn(0x7f96e00ff610 msgr2=0x7f96e0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 -- 172.21.15.60:0/1407391294 shutdown_connections 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.376+0000 7f96e6b75640 1 -- 172.21.15.60:0/1407391294 wait complete. 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 Processor -- start 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 -- start start 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0103b80 0x7f96e019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 0x7f96e019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0109e10 0x7f96e01a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0113ad0 con 0x7f96e01094c0 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0113950 con 0x7f96e0109e10 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e6b75640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f96e0113c50 con 0x7f96e0103b80 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 0x7f96e019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 0x7f96e019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37656/0 (socket says 172.21.15.60:37656) 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 -- 172.21.15.60:0/766451600 learned_addr learned my addr 172.21.15.60:0/766451600 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e5112640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0109e10 0x7f96e01a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e4911640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0103b80 0x7f96e019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 -- 172.21.15.60:0/766451600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0103b80 msgr2=0x7f96e019c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0103b80 0x7f96e019c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 -- 172.21.15.60:0/766451600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0109e10 msgr2=0x7f96e01a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0109e10 0x7f96e01a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96dffff640 1 -- 172.21.15.60:0/766451600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e01a25d0 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.377+0000 7f96e5112640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0109e10 0x7f96e01a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.378+0000 7f96dffff640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 0x7f96e019cc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f96d000eb90 tx=0x7f96d000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.378+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0004d20 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.378+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96d000ee90 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.378+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d00107f0 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.378+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e01a28c0 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.378+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e01a9020 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.379+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e0103f90 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.380+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f96d0004fc0 con 0x7f96e01094c0 2024-09-21T07:33:23.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.381+0000 7f96ddffb640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f96cc0b65a0 0x7f96cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:23.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.381+0000 7f96e4911640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f96cc0b65a0 0x7f96cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:23.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.381+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f96d00e7bf0 con 0x7f96e01094c0 2024-09-21T07:33:23.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.382+0000 7f96e4911640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f96cc0b65a0 0x7f96cc0b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009aa0 tx=0x7f96c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:23.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.385+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96d00ae4d0 con 0x7f96e01094c0 2024-09-21T07:33:23.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.573+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f96e019d790 con 0x7f96e01094c0 2024-09-21T07:33:23.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.573+0000 7f96ddffb640 1 -- 172.21.15.60:0/766451600 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v54) ==== 86+0+133 (secure 0 0 0) 0x7f96d00b28b0 con 0x7f96e01094c0 2024-09-21T07:33:23.575 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f96cc0b65a0 msgr2=0x7f96cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f96cc0b65a0 0x7f96cc0b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009aa0 tx=0x7f96c8005f90 comp rx=0 tx=0).stop 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 msgr2=0x7f96e019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 0x7f96e019cc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f96d000eb90 tx=0x7f96d000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 shutdown_connections 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f96cc0b65a0 0x7f96cc0b8ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e0109e10 0x7f96e01a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96e01094c0 0x7f96e019cc00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 --2- 172.21.15.60:0/766451600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0103b80 0x7f96e019c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 >> 172.21.15.60:0/766451600 conn(0x7f96e00ff610 msgr2=0x7f96e0108ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 shutdown_connections 2024-09-21T07:33:23.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:23.576+0000 7f96e6b75640 1 -- 172.21.15.60:0/766451600 wait complete. 2024-09-21T07:33:24.187 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:23 smithi060 ceph-mon[31244]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-21T07:33:24.187 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/766451600' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:33:24.217 INFO:teuthology.orchestra.run.smithi060.stdout:[{"version":54,"timestamp":"2024-09-21T07:32:44.276476+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T07:33:24.217 INFO:tasks.ceph_manager:config epoch is 54 2024-09-21T07:33:24.217 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:33:24.218 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:33:24.218 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:33:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:23 smithi187 ceph-mon[34367]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-21T07:33:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/766451600' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:33:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:23 smithi123 ceph-mon[34166]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-21T07:33:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/766451600' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:33:24.479 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 -- 172.21.15.60:0/827654721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac103b80 msgr2=0x7fceac103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 --2- 172.21.15.60:0/827654721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac103b80 0x7fceac103f90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009900 tx=0x7fce9c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 -- 172.21.15.60:0/827654721 shutdown_connections 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 --2- 172.21.15.60:0/827654721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 0x7fceac110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 --2- 172.21.15.60:0/827654721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac1094c0 0x7fceac1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 --2- 172.21.15.60:0/827654721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac103b80 0x7fceac103f90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 -- 172.21.15.60:0/827654721 >> 172.21.15.60:0/827654721 conn(0x7fceac0ff610 msgr2=0x7fceac101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 -- 172.21.15.60:0/827654721 shutdown_connections 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.967+0000 7fceb0813640 1 -- 172.21.15.60:0/827654721 wait complete. 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 Processor -- start 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 -- start start 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac103b80 0x7fceac19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 0x7fceac19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 0x7fceac1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fceac113ad0 con 0x7fceac1094c0 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fceac113950 con 0x7fceac109e10 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fceb0813640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fceac113c50 con 0x7fceac103b80 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fcea9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 0x7fceac19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fcea9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 0x7fceac19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37676/0 (socket says 172.21.15.60:37676) 2024-09-21T07:33:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.968+0000 7fcea9d9b640 1 -- 172.21.15.60:0/1275204576 learned_addr learned my addr 172.21.15.60:0/1275204576 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fceaa59c640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac103b80 0x7fceac19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fceaad9d640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 0x7fceac1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fcea9d9b640 1 -- 172.21.15.60:0/1275204576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac103b80 msgr2=0x7fceac19c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fcea9d9b640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac103b80 0x7fceac19c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fcea9d9b640 1 -- 172.21.15.60:0/1275204576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 msgr2=0x7fceac1a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fcea9d9b640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 0x7fceac1a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fcea9d9b640 1 -- 172.21.15.60:0/1275204576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac1a2650 con 0x7fceac1094c0 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fceaa59c640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac103b80 0x7fceac19c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fceaad9d640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 0x7fceac1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fcea9d9b640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 0x7fceac19cc80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcea000ea20 tx=0x7fcea000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea000cde0 con 0x7fceac1094c0 2024-09-21T07:33:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac1a2940 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcea0005020 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea00116d0 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.969+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac1a90a0 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.970+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceac103f90 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.972+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcea00051d0 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.973+0000 7fce9b7fe640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce940b65a0 0x7fce940b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.973+0000 7fceaa59c640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce940b65a0 0x7fce940b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.973+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fcea00e7b10 con 0x7fceac1094c0 2024-09-21T07:33:24.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.973+0000 7fceaa59c640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce940b65a0 0x7fce940b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce9c031440 tx=0x7fce9c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:24.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:24.976+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcea0016030 con 0x7fceac1094c0 2024-09-21T07:33:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.217+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fceac19d810 con 0x7fceac1094c0 2024-09-21T07:33:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.222+0000 7fce9b7fe640 1 -- 172.21.15.60:0/1275204576 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296438 (secure 0 0 0) 0x7fceac19d810 con 0x7fceac1094c0 2024-09-21T07:33:25.226 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce940b65a0 msgr2=0x7fce940b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce940b65a0 0x7fce940b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce9c031440 tx=0x7fce9c009680 comp rx=0 tx=0).stop 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 msgr2=0x7fceac19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 0x7fceac19cc80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcea000ea20 tx=0x7fcea000eee0 comp rx=0 tx=0).stop 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 shutdown_connections 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fce940b65a0 0x7fce940b8ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fceac109e10 0x7fceac1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceac1094c0 0x7fceac19cc80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 --2- 172.21.15.60:0/1275204576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fceac103b80 0x7fceac19c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 >> 172.21.15.60:0/1275204576 conn(0x7fceac0ff610 msgr2=0x7fceac108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 shutdown_connections 2024-09-21T07:33:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:25.226+0000 7fceb0813640 1 -- 172.21.15.60:0/1275204576 wait complete. 2024-09-21T07:33:25.867 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2850568081},{"type":"v1","addr":"172.21.15.60:6801","nonce":2850568081}]},"active_addr":"172.21.15.60:6801/2850568081","active_change":"2024-09-21T07:25:32.507744+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24118,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24140,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.60:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":4187795353}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2498656104}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":4107796907}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2038424059}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2891759562}]}]} 2024-09-21T07:33:25.873 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:33:25.873 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:33:25.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:33:26.133 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:26.255 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:25 smithi060 ceph-mon[31244]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-21T07:33:26.255 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:25 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1275204576' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:33:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:25 smithi187 ceph-mon[34367]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-21T07:33:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:25 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1275204576' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:33:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:25 smithi123 ceph-mon[34166]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-21T07:33:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:25 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1275204576' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:33:26.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 -- 172.21.15.60:0/2078216610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f8108600 msgr2=0x7fb5f8108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:26.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2078216610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f8108600 0x7fb5f8108a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009900 tx=0x7fb5e802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 -- 172.21.15.60:0/2078216610 shutdown_connections 2024-09-21T07:33:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2078216610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f8108f50 0x7fb5f810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2078216610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f8108600 0x7fb5f8108a10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2078216610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f81031c0 0x7fb5f81035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 -- 172.21.15.60:0/2078216610 >> 172.21.15.60:0/2078216610 conn(0x7fb5f8077cc0 msgr2=0x7fb5f8078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:26.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 -- 172.21.15.60:0/2078216610 shutdown_connections 2024-09-21T07:33:26.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.607+0000 7fb6000d1640 1 -- 172.21.15.60:0/2078216610 wait complete. 2024-09-21T07:33:26.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 Processor -- start 2024-09-21T07:33:26.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 -- start start 2024-09-21T07:33:26.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 0x7fb5f80fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:26.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f8108600 0x7fb5f80ff340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f8108f50 0x7fb5f80ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8112c10 con 0x7fb5f81031c0 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8112a90 con 0x7fb5f8108600 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.608+0000 7fb6000d1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8112d90 con 0x7fb5f8108f50 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 0x7fb5f80fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fd66c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f8108600 0x7fb5f80ff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 0x7fb5f80fee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34628/0 (socket says 172.21.15.60:34628) 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 -- 172.21.15.60:0/2410230747 learned_addr learned my addr 172.21.15.60:0/2410230747 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fe66e640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f8108f50 0x7fb5f80ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 -- 172.21.15.60:0/2410230747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f8108f50 msgr2=0x7fb5f80ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f8108f50 0x7fb5f80ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 -- 172.21.15.60:0/2410230747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f8108600 msgr2=0x7fb5f80ff340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f8108600 0x7fb5f80ff340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 -- 172.21.15.60:0/2410230747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f81a8a70 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fe66e640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f8108f50 0x7fb5f80ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5fde6d640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 0x7fb5f80fee00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d950 tx=0x7fb5f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4017030 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f81a8d60 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f4004020 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.609+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40047a0 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.610+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f81a9260 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.610+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f81035d0 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.612+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb5f4009a30 con 0x7fb5f81031c0 2024-09-21T07:33:26.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.613+0000 7fb5eeffd640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb5e40b65a0 0x7fb5e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:26.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.613+0000 7fb5fd66c640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb5e40b65a0 0x7fb5e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:26.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.613+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fb5f40e7480 con 0x7fb5f81031c0 2024-09-21T07:33:26.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.613+0000 7fb5fd66c640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb5e40b65a0 0x7fb5e40b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009230 tx=0x7fb5e8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:26.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.616+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5f40adc60 con 0x7fb5f81031c0 2024-09-21T07:33:26.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.809+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5f8100100 con 0x7fb5f81031c0 2024-09-21T07:33:26.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.811+0000 7fb5eeffd640 1 -- 172.21.15.60:0/2410230747 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22266 (secure 0 0 0) 0x7fb5f40b2040 con 0x7fb5f81031c0 2024-09-21T07:33:26.812 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:26.813 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:32:53.917839+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb5e40b65a0 msgr2=0x7fb5e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb5e40b65a0 0x7fb5e40b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009230 tx=0x7fb5e8031400 comp rx=0 tx=0).stop 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 msgr2=0x7fb5f80fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 0x7fb5f80fee00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400d950 tx=0x7fb5f400de10 comp rx=0 tx=0).stop 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 shutdown_connections 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb5e40b65a0 0x7fb5e40b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb5f8108f50 0x7fb5f80ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5f8108600 0x7fb5f80ff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 --2- 172.21.15.60:0/2410230747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f81031c0 0x7fb5f80fee00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 >> 172.21.15.60:0/2410230747 conn(0x7fb5f8077cc0 msgr2=0x7fb5f8101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 shutdown_connections 2024-09-21T07:33:26.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:26.813+0000 7fb6000d1640 1 -- 172.21.15.60:0/2410230747 wait complete. 2024-09-21T07:33:27.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:26 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2410230747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:27.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:26 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2410230747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:27.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:26 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2410230747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:27.565 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:33:27.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:33:27.831 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:28.215 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:27 smithi060 ceph-mon[31244]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-21T07:33:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:27 smithi187 ceph-mon[34367]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 -- 172.21.15.60:0/357183032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c109e00 msgr2=0x7fbb6c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/357183032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c109e00 0x7fbb6c110630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009ca0 tx=0x7fbb6402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 -- 172.21.15.60:0/357183032 shutdown_connections 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/357183032 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c109e00 0x7fbb6c110630 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/357183032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/357183032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c101f70 0x7fbb6c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 -- 172.21.15.60:0/357183032 >> 172.21.15.60:0/357183032 conn(0x7fbb6c077c60 msgr2=0x7fbb6c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:28.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 -- 172.21.15.60:0/357183032 shutdown_connections 2024-09-21T07:33:28.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.306+0000 7fbb70f2c640 1 -- 172.21.15.60:0/357183032 wait complete. 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.307+0000 7fbb70f2c640 1 Processor -- start 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.307+0000 7fbb70f2c640 1 -- start start 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb70f2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c101f70 0x7fbb6c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb70f2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb70f2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb6c109e00 0x7fbb6c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb70f2c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c113ac0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb70f2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c113940 con 0x7fbb6c109e00 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb70f2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c113c40 con 0x7fbb6c101f70 2024-09-21T07:33:28.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34640/0 (socket says 172.21.15.60:34640) 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 -- 172.21.15.60:0/2574687414 learned_addr learned my addr 172.21.15.60:0/2574687414 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb6a59c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c101f70 0x7fbb6c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb6ad9d640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb6c109e00 0x7fbb6c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 -- 172.21.15.60:0/2574687414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c101f70 msgr2=0x7fbb6c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c101f70 0x7fbb6c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 -- 172.21.15.60:0/2574687414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb6c109e00 msgr2=0x7fbb6c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb6c109e00 0x7fbb6c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 -- 172.21.15.60:0/2574687414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c1a03e0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.308+0000 7fbb61d9b640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c19aa10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d740 tx=0x7fbb5400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.309+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54017070 con 0x7fbb6c1094b0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.309+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c1a06d0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.309+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb5400de50 con 0x7fbb6c1094b0 2024-09-21T07:33:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.309+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400f620 con 0x7fbb6c1094b0 2024-09-21T07:33:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.309+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c102df0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.310+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c102380 con 0x7fbb6c1094b0 2024-09-21T07:33:28.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.313+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbb5401a070 con 0x7fbb6c1094b0 2024-09-21T07:33:28.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.313+0000 7fbb63fff640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbb580b65a0 0x7fbb580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:28.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.313+0000 7fbb6a59c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbb580b65a0 0x7fbb580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:28.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.314+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fbb540e6be0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.314+0000 7fbb6a59c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbb580b65a0 0x7fbb580b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00bbe0 tx=0x7fbb5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:28.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.315+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb540b18a0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:27 smithi123 ceph-mon[34166]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 8 op/s 2024-09-21T07:33:28.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.505+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb6c10bc20 con 0x7fbb6c1094b0 2024-09-21T07:33:28.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.506+0000 7fbb63fff640 1 -- 172.21.15.60:0/2574687414 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22266 (secure 0 0 0) 0x7fbb540b67e0 con 0x7fbb6c1094b0 2024-09-21T07:33:28.509 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:28.509 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:32:53.917839+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbb580b65a0 msgr2=0x7fbb580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbb580b65a0 0x7fbb580b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00bbe0 tx=0x7fbb5c00b390 comp rx=0 tx=0).stop 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 msgr2=0x7fbb6c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c19aa10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d740 tx=0x7fbb5400dc00 comp rx=0 tx=0).stop 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 shutdown_connections 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fbb580b65a0 0x7fbb580b8ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb6c109e00 0x7fbb6c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb6c1094b0 0x7fbb6c19aa10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 --2- 172.21.15.60:0/2574687414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c101f70 0x7fbb6c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:28.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 >> 172.21.15.60:0/2574687414 conn(0x7fbb6c077c60 msgr2=0x7fbb6c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:28.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 shutdown_connections 2024-09-21T07:33:28.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:28.509+0000 7fbb70f2c640 1 -- 172.21.15.60:0/2574687414 wait complete. 2024-09-21T07:33:29.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:28 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2574687414' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:29.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:28 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2574687414' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:29.274 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:33:29.274 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:33:29.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:33:29.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:33:29.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:33:29.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:33:29.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T07:33:29.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T07:33:29.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T07:33:29.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T07:33:29.279 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T07:33:29.279 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T07:33:29.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:28 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2574687414' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:33:29.995 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:30.006 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:30.016 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:30.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:29 smithi060 ceph-mon[31244]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T07:33:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:29 smithi187 ceph-mon[34367]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T07:33:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:29 smithi123 ceph-mon[34166]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T07:33:30.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.743+0000 7f37b6370640 1 -- 172.21.15.60:0/3675865728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0103b60 msgr2=0x7f37b0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.743+0000 7f37b6370640 1 --2- 172.21.15.60:0/3675865728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0103b60 0x7f37b0103f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009900 tx=0x7f37a002a410 comp rx=0 tx=0).stop 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 -- 172.21.15.60:0/3675865728 shutdown_connections 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 --2- 172.21.15.60:0/3675865728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37b0109df0 0x7f37b0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 --2- 172.21.15.60:0/3675865728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37b01094a0 0x7f37b01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 --2- 172.21.15.60:0/3675865728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0103b60 0x7f37b0103f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 -- 172.21.15.60:0/3675865728 >> 172.21.15.60:0/3675865728 conn(0x7f37b007b850 msgr2=0x7f37b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 -- 172.21.15.60:0/3675865728 shutdown_connections 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 -- 172.21.15.60:0/3675865728 wait complete. 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 Processor -- start 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.744+0000 7f37b6370640 1 -- start start 2024-09-21T07:33:30.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b6370640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37b0103b60 0x7f37b019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b6370640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37b01094a0 0x7f37b019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b6370640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0109df0 0x7f37b019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b6370640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37b0113b40 con 0x7f37b0109df0 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b6370640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37b01139c0 con 0x7f37b01094a0 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b6370640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f37b0113cc0 con 0x7f37b0103b60 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b490d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0109df0 0x7f37b019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b490d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0109df0 0x7f37b019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34668/0 (socket says 172.21.15.60:34668) 2024-09-21T07:33:30.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37b490d640 1 -- 172.21.15.60:0/2531745312 learned_addr learned my addr 172.21.15.60:0/2531745312 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37affff640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37b0103b60 0x7f37b019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.745+0000 7f37af7fe640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37b01094a0 0x7f37b019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b490d640 1 -- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37b0103b60 msgr2=0x7f37b019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b490d640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37b0103b60 0x7f37b019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b490d640 1 -- 172.21.15.60:0/2531745312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37b01094a0 msgr2=0x7f37b019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b490d640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37b01094a0 0x7f37b019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b490d640 1 -- 172.21.15.60:0/2531745312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b01a0460 con 0x7f37b0109df0 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b490d640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0109df0 0x7f37b019fd30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f37a800eaa0 tx=0x7f37a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a800cdb0 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37a8005020 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b01a0750 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a80116d0 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.746+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b01a6eb0 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.747+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37b0063b10 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.749+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f37a80051d0 con 0x7f37b0109df0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.749+0000 7f37ad7fa640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f37980b65a0 0x7f37980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.749+0000 7f37affff640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f37980b65a0 0x7f37980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.749+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f37a80e79a0 con 0x7f37b0109df0 2024-09-21T07:33:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.750+0000 7f37ad7fa640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] conn(0x7f37980bfd30 0x7f37980c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.750+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 --> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37a801be50 con 0x7f37980bfd30 2024-09-21T07:33:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.750+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f37a80e7e80 con 0x7f37b0109df0 2024-09-21T07:33:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.750+0000 7f37af7fe640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] conn(0x7f37980bfd30 0x7f37980c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.750+0000 7f37affff640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f37980b65a0 0x7f37980b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37a0000c00 tx=0x7f37a0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.750+0000 7f37af7fe640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] conn(0x7f37980bfd30 0x7f37980c2180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:30.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.751+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== osd.5 v2:172.21.15.187:6808/3494184660 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37a801be50 con 0x7f37980bfd30 2024-09-21T07:33:30.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.765+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 --> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37b0063f90 con 0x7f37980bfd30 2024-09-21T07:33:30.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37ad7fa640 1 -- 172.21.15.60:0/2531745312 <== osd.5 v2:172.21.15.187:6808/3494184660 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f37b0063f90 con 0x7f37980bfd30 2024-09-21T07:33:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] conn(0x7f37980bfd30 msgr2=0x7f37980c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] conn(0x7f37980bfd30 0x7f37980c2180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:30.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f37980b65a0 msgr2=0x7f37980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f37980b65a0 0x7f37980b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f37a0000c00 tx=0x7f37a0031400 comp rx=0 tx=0).stop 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0109df0 msgr2=0x7f37b019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 --2- 172.21.15.60:0/2531745312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b0109df0 0x7f37b019fd30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f37a800eaa0 tx=0x7f37a800ef60 comp rx=0 tx=0).stop 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b490d640 1 -- 172.21.15.60:0/2531745312 reap_dead start 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 shutdown_connections 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 >> 172.21.15.60:0/2531745312 conn(0x7f37b007b850 msgr2=0x7f37b0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 shutdown_connections 2024-09-21T07:33:30.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.766+0000 7f37b6370640 1 -- 172.21.15.60:0/2531745312 wait complete. 2024-09-21T07:33:31.376 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:31.384 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:31.387 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:31.387 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:31.392 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:31.393 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 -- 172.21.15.60:0/391069285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 msgr2=0x7fddf8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 --2- 172.21.15.60:0/391069285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf8102e70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009900 tx=0x7fdde802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 -- 172.21.15.60:0/391069285 shutdown_connections 2024-09-21T07:33:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 --2- 172.21.15.60:0/391069285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddf8108cf0 0x7fddf810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 --2- 172.21.15.60:0/391069285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf81083a0 0x7fddf81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 --2- 172.21.15.60:0/391069285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf8102e70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 -- 172.21.15.60:0/391069285 >> 172.21.15.60:0/391069285 conn(0x7fddf8079730 msgr2=0x7fddf8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 -- 172.21.15.60:0/391069285 shutdown_connections 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.971+0000 7fddfdad4640 1 -- 172.21.15.60:0/391069285 wait complete. 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.972+0000 7fddfdad4640 1 Processor -- start 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 -- start start 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf81083a0 0x7fddf819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddf8108cf0 0x7fddf819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8113a80 con 0x7fddf8102a60 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8113900 con 0x7fddf81083a0 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddfdad4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8113c00 con 0x7fddf8108cf0 2024-09-21T07:33:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34684/0 (socket says 172.21.15.60:34684) 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 -- 172.21.15.60:0/676413686 learned_addr learned my addr 172.21.15.60:0/676413686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf7fff640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddf8108cf0 0x7fddf819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf6ffd640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf81083a0 0x7fddf819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 -- 172.21.15.60:0/676413686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddf8108cf0 msgr2=0x7fddf819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddf8108cf0 0x7fddf819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 -- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf81083a0 msgr2=0x7fddf819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf81083a0 0x7fddf819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf77fe640 1 -- 172.21.15.60:0/676413686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf81a0380 con 0x7fddf8102a60 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf7fff640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddf8108cf0 0x7fddf819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.973+0000 7fddf6ffd640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf81083a0 0x7fddf819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.974+0000 7fddf77fe640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf819a410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006010 tx=0x7fdde80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.974+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde803f030 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.974+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf81a0610 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.974+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdde8003800 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.974+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8035070 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.974+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf81a6dd0 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.975+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fddf8063b50 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.977+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdde8003cb0 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.977+0000 7fddf4ff9640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdde00b65a0 0x7fdde00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.977+0000 7fddf6ffd640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdde00b65a0 0x7fdde00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.977+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7fdde8108410 con 0x7fddf8102a60 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.978+0000 7fddf4ff9640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] conn(0x7fdde00bfd30 0x7fdde00c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.978+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 --> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdde00c2850 con 0x7fdde00bfd30 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.978+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fdde81088f0 con 0x7fddf8102a60 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.978+0000 7fddf6ffd640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdde00b65a0 0x7fdde00b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddf8100b70 tx=0x7fddec005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.978+0000 7fddf7fff640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] conn(0x7fdde00bfd30 0x7fdde00c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.978+0000 7fddf7fff640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] conn(0x7fdde00bfd30 0x7fdde00c2180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.979+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== osd.1 v2:172.21.15.123:6800/1737463834 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdde00c2850 con 0x7fdde00bfd30 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.993+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 --> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fddf8063fd0 con 0x7fdde00bfd30 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddf4ff9640 1 -- 172.21.15.60:0/676413686 <== osd.1 v2:172.21.15.123:6800/1737463834 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fddf8063fd0 con 0x7fdde00bfd30 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] conn(0x7fdde00bfd30 msgr2=0x7fdde00c2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] conn(0x7fdde00bfd30 0x7fdde00c2180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdde00b65a0 msgr2=0x7fdde00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fdde00b65a0 0x7fdde00b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddf8100b70 tx=0x7fddec005d30 comp rx=0 tx=0).stop 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 msgr2=0x7fddf819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 --2- 172.21.15.60:0/676413686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddf8102a60 0x7fddf819a410 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006010 tx=0x7fdde80042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddf7fff640 1 -- 172.21.15.60:0/676413686 reap_dead start 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 shutdown_connections 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 >> 172.21.15.60:0/676413686 conn(0x7fddf8079730 msgr2=0x7fddf8101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 shutdown_connections 2024-09-21T07:33:31.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:30.994+0000 7fddfdad4640 1 -- 172.21.15.60:0/676413686 wait complete. 2024-09-21T07:33:31.680 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:32.193 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:31 smithi060 ceph-mon[31244]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T07:33:32.195 INFO:teuthology.orchestra.run.smithi060.stdout:51539607624 2024-09-21T07:33:32.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T07:33:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:31 smithi187 ceph-mon[34367]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T07:33:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:31 smithi123 ceph-mon[34166]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 -- 172.21.15.60:0/3023031013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 msgr2=0x7f705010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 --2- 172.21.15.60:0/3023031013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705010f520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7048009900 tx=0x7f704802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 -- 172.21.15.60:0/3023031013 shutdown_connections 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 --2- 172.21.15.60:0/3023031013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705010f520 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 --2- 172.21.15.60:0/3023031013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70501083a0 0x7f70501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 --2- 172.21.15.60:0/3023031013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7050102a60 0x7f7050102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 -- 172.21.15.60:0/3023031013 >> 172.21.15.60:0/3023031013 conn(0x7f7050079730 msgr2=0x7f7050079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 -- 172.21.15.60:0/3023031013 shutdown_connections 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 -- 172.21.15.60:0/3023031013 wait complete. 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.641+0000 7f705570d640 1 Processor -- start 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 -- start start 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7050102a60 0x7f7050199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70501083a0 0x7f70501998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7050112960 con 0x7f7050108cf0 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70501127e0 con 0x7f70501083a0 2024-09-21T07:33:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f705570d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7050112ae0 con 0x7f7050102a60 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f704f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f704f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705019eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34690/0 (socket says 172.21.15.60:34690) 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f704f7fe640 1 -- 172.21.15.60:0/106967766 learned_addr learned my addr 172.21.15.60:0/106967766 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f704e7fc640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70501083a0 0x7f70501998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f704effd640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7050102a60 0x7f7050199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.642+0000 7f704f7fe640 1 -- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7050102a60 msgr2=0x7f7050199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f704f7fe640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7050102a60 0x7f7050199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f704f7fe640 1 -- 172.21.15.60:0/106967766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70501083a0 msgr2=0x7f70501998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f704f7fe640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70501083a0 0x7f70501998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f704f7fe640 1 -- 172.21.15.60:0/106967766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705019f1c0 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f704e7fc640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70501083a0 0x7f70501998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f704f7fe640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705019eb50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7048004770 tx=0x7f7048004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704803f030 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7048003aa0 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705019f450 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7048035070 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.643+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f705019f930 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.644+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7050063b50 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.646+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7048042030 con 0x7f7050108cf0 2024-09-21T07:33:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.646+0000 7f7037fff640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f70380b65d0 0x7f70380b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.646+0000 7f704effd640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f70380b65d0 0x7f70380b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.646+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f70481081f0 con 0x7f7050108cf0 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.647+0000 7f7037fff640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] conn(0x7f70380bfd60 0x7f70380c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.647+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 --> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70380c2880 con 0x7f70380bfd60 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.647+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f70481086d0 con 0x7f7050108cf0 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.647+0000 7f704effd640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f70380b65d0 0x7f70380b8ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7040005c40 tx=0x7f7040005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.647+0000 7f704e7fc640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] conn(0x7f70380bfd60 0x7f70380c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.647+0000 7f704e7fc640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] conn(0x7f70380bfd60 0x7f70380c21b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.648+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== osd.8 v2:172.21.15.187:6816/2898656123 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70380c2880 con 0x7f70380bfd60 2024-09-21T07:33:32.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.663+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 --> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7050063f50 con 0x7f70380bfd60 2024-09-21T07:33:32.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.663+0000 7f7037fff640 1 -- 172.21.15.60:0/106967766 <== osd.8 v2:172.21.15.187:6816/2898656123 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7050063f50 con 0x7f70380bfd60 2024-09-21T07:33:32.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.663+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] conn(0x7f70380bfd60 msgr2=0x7f70380c21b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.663+0000 7f705570d640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] conn(0x7f70380bfd60 0x7f70380c21b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f70380b65d0 msgr2=0x7f70380b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f70380b65d0 0x7f70380b8ae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7040005c40 tx=0x7f7040005bd0 comp rx=0 tx=0).stop 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 msgr2=0x7f705019eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 --2- 172.21.15.60:0/106967766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7050108cf0 0x7f705019eb50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7048004770 tx=0x7f7048004270 comp rx=0 tx=0).stop 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f704f7fe640 1 -- 172.21.15.60:0/106967766 reap_dead start 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 shutdown_connections 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 >> 172.21.15.60:0/106967766 conn(0x7f7050079730 msgr2=0x7f70501043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 shutdown_connections 2024-09-21T07:33:32.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.664+0000 7f705570d640 1 -- 172.21.15.60:0/106967766 wait complete. 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:33:33.102 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:32 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T07:33:33.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T07:33:33.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T07:33:33.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T07:33:33.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T07:33:33.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T07:33:33.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:33:33.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:32 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T07:33:33.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T07:33:33.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T07:33:33.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T07:33:33.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T07:33:33.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T07:33:33.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:33:33.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:32 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-21T07:33:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 -- 172.21.15.60:0/1490512314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc1052b0 msgr2=0x7f54dc10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 --2- 172.21.15.60:0/1490512314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc1052b0 0x7f54dc10d8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009900 tx=0x7f54cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 -- 172.21.15.60:0/1490512314 shutdown_connections 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 --2- 172.21.15.60:0/1490512314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54dc10de30 0x7f54dc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 --2- 172.21.15.60:0/1490512314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc1052b0 0x7f54dc10d8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 --2- 172.21.15.60:0/1490512314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc104880 0x7f54dc104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 -- 172.21.15.60:0/1490512314 >> 172.21.15.60:0/1490512314 conn(0x7f54dc079730 msgr2=0x7f54dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 -- 172.21.15.60:0/1490512314 shutdown_connections 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.606+0000 7f54e3294640 1 -- 172.21.15.60:0/1490512314 wait complete. 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 Processor -- start 2024-09-21T07:33:33.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 -- start start 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc104880 0x7f54dc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc1052b0 0x7f54dc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54dc10de30 0x7f54dc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc113a70 con 0x7f54dc104880 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc1138f0 con 0x7f54dc1052b0 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e3294640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc113bf0 con 0x7f54dc10de30 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e1030640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc104880 0x7f54dc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e1030640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc104880 0x7f54dc19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34738/0 (socket says 172.21.15.60:34738) 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.607+0000 7f54e1030640 1 -- 172.21.15.60:0/3287641437 learned_addr learned my addr 172.21.15.60:0/3287641437 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:33.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e082f640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc1052b0 0x7f54dc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1831640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54dc10de30 0x7f54dc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1030640 1 -- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54dc10de30 msgr2=0x7f54dc19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1030640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54dc10de30 0x7f54dc19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1030640 1 -- 172.21.15.60:0/3287641437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc1052b0 msgr2=0x7f54dc19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1030640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc1052b0 0x7f54dc19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1030640 1 -- 172.21.15.60:0/3287641437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc1a0410 con 0x7f54dc104880 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e1030640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc104880 0x7f54dc19a4a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f54d800d950 tx=0x7f54d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8017020 con 0x7f54dc104880 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc1a0700 con 0x7f54dc104880 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d8009c30 con 0x7f54dc104880 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d800f6b0 con 0x7f54dc104880 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.608+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc1a6e60 con 0x7f54dc104880 2024-09-21T07:33:33.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.609+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54dc063b50 con 0x7f54dc104880 2024-09-21T07:33:33.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.611+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f54d801a020 con 0x7f54dc104880 2024-09-21T07:33:33.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54d27fc640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54c80b65a0 0x7f54c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54e082f640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54c80b65a0 0x7f54c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f54d80e78f0 con 0x7f54dc104880 2024-09-21T07:33:33.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54d27fc640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] conn(0x7f54c80c0010 0x7f54c80c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 --> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54c80c2bd0 con 0x7f54c80c0010 2024-09-21T07:33:33.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f54d80e7d40 con 0x7f54dc104880 2024-09-21T07:33:33.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.612+0000 7f54e082f640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54c80b65a0 0x7f54c80b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54cc000c00 tx=0x7f54cc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.613+0000 7f54e1831640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] conn(0x7f54c80c0010 0x7f54c80c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.613+0000 7f54e1831640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] conn(0x7f54c80c0010 0x7f54c80c2500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.614+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== osd.11 v2:172.21.15.187:6824/2953073093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54c80c2bd0 con 0x7f54c80c0010 2024-09-21T07:33:33.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.631+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 --> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54dc063f80 con 0x7f54c80c0010 2024-09-21T07:33:33.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.631+0000 7f54d27fc640 1 -- 172.21.15.60:0/3287641437 <== osd.11 v2:172.21.15.187:6824/2953073093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f54dc063f80 con 0x7f54c80c0010 2024-09-21T07:33:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] conn(0x7f54c80c0010 msgr2=0x7f54c80c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] conn(0x7f54c80c0010 0x7f54c80c2500 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54c80b65a0 msgr2=0x7f54c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54c80b65a0 0x7f54c80b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54cc000c00 tx=0x7f54cc031400 comp rx=0 tx=0).stop 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc104880 msgr2=0x7f54dc19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 --2- 172.21.15.60:0/3287641437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54dc104880 0x7f54dc19a4a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f54d800d950 tx=0x7f54d800de10 comp rx=0 tx=0).stop 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e1831640 1 -- 172.21.15.60:0/3287641437 reap_dead start 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 shutdown_connections 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 >> 172.21.15.60:0/3287641437 conn(0x7f54dc079730 msgr2=0x7f54dc1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 shutdown_connections 2024-09-21T07:33:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.632+0000 7f54e3294640 1 -- 172.21.15.60:0/3287641437 wait complete. 2024-09-21T07:33:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 -- 172.21.15.60:0/729029280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638102ae0 msgr2=0x7fd638102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 --2- 172.21.15.60:0/729029280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638102ae0 0x7fd638102ef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd634009900 tx=0x7fd63402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 -- 172.21.15.60:0/729029280 shutdown_connections 2024-09-21T07:33:33.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 --2- 172.21.15.60:0/729029280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd638108d20 0x7fd63810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 --2- 172.21.15.60:0/729029280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6381083d0 0x7fd6381087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 --2- 172.21.15.60:0/729029280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638102ae0 0x7fd638102ef0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 -- 172.21.15.60:0/729029280 >> 172.21.15.60:0/729029280 conn(0x7fd6380797b0 msgr2=0x7fd638079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 -- 172.21.15.60:0/729029280 shutdown_connections 2024-09-21T07:33:33.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.826+0000 7fd64037f640 1 -- 172.21.15.60:0/729029280 wait complete. 2024-09-21T07:33:33.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.827+0000 7fd64037f640 1 Processor -- start 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.827+0000 7fd64037f640 1 -- start start 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd64037f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd638102ae0 0x7fd638110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd64037f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6381083d0 0x7fd638110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd64037f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638108d20 0x7fd638110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd64037f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd638113b00 con 0x7fd638108d20 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd64037f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd638113980 con 0x7fd6381083d0 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd64037f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd638113c80 con 0x7fd638102ae0 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638108d20 0x7fd638110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638108d20 0x7fd638110ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34766/0 (socket says 172.21.15.60:34766) 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 -- 172.21.15.60:0/2584636585 learned_addr learned my addr 172.21.15.60:0/2584636585 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e11b640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd638102ae0 0x7fd638110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63d91a640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6381083d0 0x7fd638110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 -- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd638102ae0 msgr2=0x7fd638110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd638102ae0 0x7fd638110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 -- 172.21.15.60:0/2584636585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6381083d0 msgr2=0x7fd638110570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6381083d0 0x7fd638110570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 -- 172.21.15.60:0/2584636585 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6381a87f0 con 0x7fd638108d20 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd63e91c640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638108d20 0x7fd638110ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd63000cad0 tx=0x7fd63000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.828+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63000ae20 con 0x7fd638108d20 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.829+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd630005020 con 0x7fd638108d20 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.829+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6381a8ae0 con 0x7fd638108d20 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.829+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63000f6b0 con 0x7fd638108d20 2024-09-21T07:33:33.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.829+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6381a9020 con 0x7fd638108d20 2024-09-21T07:33:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.830+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd638063b50 con 0x7fd638108d20 2024-09-21T07:33:33.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.831+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd6300051d0 con 0x7fd638108d20 2024-09-21T07:33:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.832+0000 7fd62f7fe640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6240b65a0 0x7fd6240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.832+0000 7fd63e11b640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6240b65a0 0x7fd6240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.832+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd6300e7740 con 0x7fd638108d20 2024-09-21T07:33:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.832+0000 7fd62f7fe640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] conn(0x7fd6240c0010 0x7fd6240c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.833+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 --> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6240c2bd0 con 0x7fd6240c0010 2024-09-21T07:33:33.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.833+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd6300e7b90 con 0x7fd638108d20 2024-09-21T07:33:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.833+0000 7fd63e11b640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6240b65a0 0x7fd6240b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd634000c00 tx=0x7fd634031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.833+0000 7fd63d91a640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] conn(0x7fd6240c0010 0x7fd6240c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.833+0000 7fd63d91a640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] conn(0x7fd6240c0010 0x7fd6240c2500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:33.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.834+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== osd.2 v2:172.21.15.187:6800/2554805440 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6240c2bd0 con 0x7fd6240c0010 2024-09-21T07:33:33.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.848+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 --> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd638063fd0 con 0x7fd6240c0010 2024-09-21T07:33:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.848+0000 7fd62f7fe640 1 -- 172.21.15.60:0/2584636585 <== osd.2 v2:172.21.15.187:6800/2554805440 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd638063fd0 con 0x7fd6240c0010 2024-09-21T07:33:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.848+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] conn(0x7fd6240c0010 msgr2=0x7fd6240c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.848+0000 7fd64037f640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] conn(0x7fd6240c0010 0x7fd6240c2500 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:33.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.848+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6240b65a0 msgr2=0x7fd6240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.848+0000 7fd64037f640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd6240b65a0 0x7fd6240b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd634000c00 tx=0x7fd634031400 comp rx=0 tx=0).stop 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638108d20 msgr2=0x7fd638110ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd64037f640 1 --2- 172.21.15.60:0/2584636585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd638108d20 0x7fd638110ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd63000cad0 tx=0x7fd63000cf90 comp rx=0 tx=0).stop 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd63e91c640 1 -- 172.21.15.60:0/2584636585 reap_dead start 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 shutdown_connections 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 >> 172.21.15.60:0/2584636585 conn(0x7fd6380797b0 msgr2=0x7fd6381064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 shutdown_connections 2024-09-21T07:33:33.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:33.849+0000 7fd64037f640 1 -- 172.21.15.60:0/2584636585 wait complete. 2024-09-21T07:33:34.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T07:33:34.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:33 smithi060 ceph-mon[31244]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:33:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T07:33:34.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:33 smithi187 ceph-mon[34367]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:33:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-21T07:33:34.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:33 smithi123 ceph-mon[34166]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 -- 172.21.15.60:0/459340409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109ec0 msgr2=0x7fc8381106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/459340409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109ec0 0x7fc8381106f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc830009900 tx=0x7fc83002a420 comp rx=0 tx=0).stop 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 -- 172.21.15.60:0/459340409 shutdown_connections 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/459340409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109ec0 0x7fc8381106f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/459340409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc838109570 0x7fc838109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/459340409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc838103c30 0x7fc838104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 -- 172.21.15.60:0/459340409 >> 172.21.15.60:0/459340409 conn(0x7fc83807b8d0 msgr2=0x7fc83807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 -- 172.21.15.60:0/459340409 shutdown_connections 2024-09-21T07:33:34.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.641+0000 7fc83cf7b640 1 -- 172.21.15.60:0/459340409 wait complete. 2024-09-21T07:33:34.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 Processor -- start 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 -- start start 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc838103c30 0x7fc838075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109570 0x7fc838075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc838109ec0 0x7fc838076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc838113b20 con 0x7fc838109570 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc8381139a0 con 0x7fc838103c30 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc83cf7b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc838113ca0 con 0x7fc838109ec0 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc835d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109570 0x7fc838075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc835d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109570 0x7fc838075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34782/0 (socket says 172.21.15.60:34782) 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.642+0000 7fc835d9b640 1 -- 172.21.15.60:0/2493591084 learned_addr learned my addr 172.21.15.60:0/2493591084 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc83659c640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc838103c30 0x7fc838075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc836d9d640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc838109ec0 0x7fc838076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc835d9b640 1 -- 172.21.15.60:0/2493591084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc838109ec0 msgr2=0x7fc838076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc835d9b640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc838109ec0 0x7fc838076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc835d9b640 1 -- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc838103c30 msgr2=0x7fc838075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc835d9b640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc838103c30 0x7fc838075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc835d9b640 1 -- 172.21.15.60:0/2493591084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381a8730 con 0x7fc838109570 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc83659c640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc838103c30 0x7fc838075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc835d9b640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109570 0x7fc838075c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc82c006fd0 tx=0x7fc82c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c011830 con 0x7fc838109570 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c016070 con 0x7fc838109570 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8381a8a20 con 0x7fc838109570 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c010e00 con 0x7fc838109570 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.643+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381a8fe0 con 0x7fc838109570 2024-09-21T07:33:34.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.644+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc838063b50 con 0x7fc838109570 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.646+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc82c01b460 con 0x7fc838109570 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc8277fe640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc8200b65a0 0x7fc8200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc83659c640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc8200b65a0 0x7fc8200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fc82c0e74f0 con 0x7fc838109570 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc8277fe640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] conn(0x7fc8200c0010 0x7fc8200c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 --> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8200c2bd0 con 0x7fc8200c0010 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fc82c0e7940 con 0x7fc838109570 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc83659c640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc8200b65a0 0x7fc8200b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc838077160 tx=0x7fc828009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.647+0000 7fc836d9d640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] conn(0x7fc8200c0010 0x7fc8200c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.648+0000 7fc836d9d640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] conn(0x7fc8200c0010 0x7fc8200c2500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:34.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.649+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== osd.10 v2:172.21.15.123:6824/771892497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8200c2bd0 con 0x7fc8200c0010 2024-09-21T07:33:34.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.663+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 --> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc838063f50 con 0x7fc8200c0010 2024-09-21T07:33:34.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.664+0000 7fc8277fe640 1 -- 172.21.15.60:0/2493591084 <== osd.10 v2:172.21.15.123:6824/771892497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc838063f50 con 0x7fc8200c0010 2024-09-21T07:33:34.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] conn(0x7fc8200c0010 msgr2=0x7fc8200c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] conn(0x7fc8200c0010 0x7fc8200c2500 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc8200b65a0 msgr2=0x7fc8200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc8200b65a0 0x7fc8200b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc838077160 tx=0x7fc828009500 comp rx=0 tx=0).stop 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109570 msgr2=0x7fc838075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 --2- 172.21.15.60:0/2493591084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc838109570 0x7fc838075c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc82c006fd0 tx=0x7fc82c00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc836d9d640 1 -- 172.21.15.60:0/2493591084 reap_dead start 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 shutdown_connections 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 >> 172.21.15.60:0/2493591084 conn(0x7fc83807b8d0 msgr2=0x7fc838107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 shutdown_connections 2024-09-21T07:33:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:34.665+0000 7fc83cf7b640 1 -- 172.21.15.60:0/2493591084 wait complete. 2024-09-21T07:33:35.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:34 smithi060 ceph-mon[31244]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 -- 172.21.15.60:0/1977081628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea01094a0 msgr2=0x7efea01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1977081628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea01094a0 0x7efea01098b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efe94009900 tx=0x7efe9402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 -- 172.21.15.60:0/1977081628 shutdown_connections 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1977081628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea0109df0 0x7efea0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1977081628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea01094a0 0x7efea01098b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1977081628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efea0103b60 0x7efea0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 -- 172.21.15.60:0/1977081628 >> 172.21.15.60:0/1977081628 conn(0x7efea007b850 msgr2=0x7efea007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 -- 172.21.15.60:0/1977081628 shutdown_connections 2024-09-21T07:33:35.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.245+0000 7efea7e6f640 1 -- 172.21.15.60:0/1977081628 wait complete. 2024-09-21T07:33:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 Processor -- start 2024-09-21T07:33:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 -- start start 2024-09-21T07:33:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea0103b60 0x7efea019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea01094a0 0x7efea019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efea0109df0 0x7efea019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efea0113ab0 con 0x7efea0103b60 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efea0113930 con 0x7efea0109df0 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea7e6f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efea0113c30 con 0x7efea01094a0 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea0103b60 0x7efea019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea0103b60 0x7efea019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34794/0 (socket says 172.21.15.60:34794) 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 -- 172.21.15.60:0/1351138104 learned_addr learned my addr 172.21.15.60:0/1351138104 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea640c640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efea0109df0 0x7efea019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea540a640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea01094a0 0x7efea019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 -- 172.21.15.60:0/1351138104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea01094a0 msgr2=0x7efea019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea01094a0 0x7efea019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 -- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efea0109df0 msgr2=0x7efea019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efea0109df0 0x7efea019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea5c0b640 1 -- 172.21.15.60:0/1351138104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea01a0450 con 0x7efea0103b60 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea540a640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efea01094a0 0x7efea019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.246+0000 7efea640c640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efea0109df0 0x7efea019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.247+0000 7efea5c0b640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea0103b60 0x7efea019a4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efe9800d950 tx=0x7efe9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.247+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98017030 con 0x7efea0103b60 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.247+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe98004020 con 0x7efea0103b60 2024-09-21T07:33:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.247+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe980047a0 con 0x7efea0103b60 2024-09-21T07:33:35.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.247+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea01a0740 con 0x7efea0103b60 2024-09-21T07:33:35.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.247+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea01a6ea0 con 0x7efea0103b60 2024-09-21T07:33:35.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.248+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efea0063b50 con 0x7efea0103b60 2024-09-21T07:33:35.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.249+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efe98009a30 con 0x7efea0103b60 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.250+0000 7efe9effd640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe880b65a0 0x7efe880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.250+0000 7efea540a640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe880b65a0 0x7efe880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.250+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7efe980e76e0 con 0x7efea0103b60 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.250+0000 7efe9effd640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] conn(0x7efe880c0010 0x7efe880c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.251+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 --> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe880c2bd0 con 0x7efe880c0010 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.251+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7efe980e7a90 con 0x7efea0103b60 2024-09-21T07:33:35.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.251+0000 7efea540a640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe880b65a0 0x7efe880b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efe94000c00 tx=0x7efe94031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:35.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.251+0000 7efea640c640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] conn(0x7efe880c0010 0x7efe880c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:35.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.251+0000 7efea640c640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] conn(0x7efe880c0010 0x7efe880c2500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:35.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.252+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== osd.7 v2:172.21.15.123:6816/203595290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe880c2bd0 con 0x7efe880c0010 2024-09-21T07:33:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.266+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 --> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efea0063fd0 con 0x7efe880c0010 2024-09-21T07:33:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.266+0000 7efe9effd640 1 -- 172.21.15.60:0/1351138104 <== osd.7 v2:172.21.15.123:6816/203595290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efea0063fd0 con 0x7efe880c0010 2024-09-21T07:33:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] conn(0x7efe880c0010 msgr2=0x7efe880c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] conn(0x7efe880c0010 0x7efe880c2500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe880b65a0 msgr2=0x7efe880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efe880b65a0 0x7efe880b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efe94000c00 tx=0x7efe94031400 comp rx=0 tx=0).stop 2024-09-21T07:33:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea0103b60 msgr2=0x7efea019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:35.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 --2- 172.21.15.60:0/1351138104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea0103b60 0x7efea019a4e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efe9800d950 tx=0x7efe9800de10 comp rx=0 tx=0).stop 2024-09-21T07:33:35.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea640c640 1 -- 172.21.15.60:0/1351138104 reap_dead start 2024-09-21T07:33:35.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 shutdown_connections 2024-09-21T07:33:35.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 >> 172.21.15.60:0/1351138104 conn(0x7efea007b850 msgr2=0x7efea01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:35.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 shutdown_connections 2024-09-21T07:33:35.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:35.267+0000 7efea7e6f640 1 -- 172.21.15.60:0/1351138104 wait complete. 2024-09-21T07:33:35.273 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:34 smithi187 ceph-mon[34367]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:33:35.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:34 smithi123 ceph-mon[34166]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:33:36.025 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:35 smithi060 ceph-mon[31244]: pgmap v307: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T07:33:36.056 INFO:teuthology.orchestra.run.smithi060.stdout:223338299427 2024-09-21T07:33:36.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T07:33:36.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.841+0000 7f367ff48640 1 -- 172.21.15.60:0/878431855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3678108d10 msgr2=0x7f367810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.841+0000 7f367ff48640 1 --2- 172.21.15.60:0/878431855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3678108d10 0x7f367810f540 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3670009ca0 tx=0x7f367002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 -- 172.21.15.60:0/878431855 shutdown_connections 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 --2- 172.21.15.60:0/878431855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3678108d10 0x7f367810f540 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 --2- 172.21.15.60:0/878431855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36781083c0 0x7f36781087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 --2- 172.21.15.60:0/878431855 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3678102a80 0x7f3678102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 -- 172.21.15.60:0/878431855 >> 172.21.15.60:0/878431855 conn(0x7f3678079740 msgr2=0x7f3678079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 -- 172.21.15.60:0/878431855 shutdown_connections 2024-09-21T07:33:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 -- 172.21.15.60:0/878431855 wait complete. 2024-09-21T07:33:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 Processor -- start 2024-09-21T07:33:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.842+0000 7f367ff48640 1 -- start start 2024-09-21T07:33:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367ff48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3678102a80 0x7f367819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367ff48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36781083c0 0x7f367819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367ff48640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3678108d10 0x7f367819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367ff48640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113aa0 con 0x7f36781083c0 2024-09-21T07:33:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367ff48640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113920 con 0x7f3678102a80 2024-09-21T07:33:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367ff48640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3678113c20 con 0x7f3678108d10 2024-09-21T07:33:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36781083c0 0x7f367819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36781083c0 0x7f367819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34710/0 (socket says 172.21.15.60:34710) 2024-09-21T07:33:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 -- 172.21.15.60:0/2722155623 learned_addr learned my addr 172.21.15.60:0/2722155623 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367e4e5640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3678108d10 0x7f367819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367dce4640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3678102a80 0x7f367819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 -- 172.21.15.60:0/2722155623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3678108d10 msgr2=0x7f367819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3678108d10 0x7f367819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 -- 172.21.15.60:0/2722155623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3678102a80 msgr2=0x7f367819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3678102a80 0x7f367819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.843+0000 7f367d4e3640 1 -- 172.21.15.60:0/2722155623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36781a0320 con 0x7f36781083c0 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.844+0000 7f367d4e3640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36781083c0 0x7f367819aa10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c970 tx=0x7f366c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.844+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c014070 con 0x7f36781083c0 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.844+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f366c004440 con 0x7f36781083c0 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.844+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36781a0610 con 0x7f36781083c0 2024-09-21T07:33:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.844+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c003e50 con 0x7f36781083c0 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.844+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36781a6e30 con 0x7f36781083c0 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.845+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3678063b50 con 0x7f36781083c0 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.847+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f366c017070 con 0x7f36781083c0 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f366affd640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36640b6770 0x7f36640b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f367dce4640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36640b6770 0x7f36640b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f366c0e7160 con 0x7f36781083c0 2024-09-21T07:33:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f366affd640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] conn(0x7f36640bff00 0x7f36640c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 --> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f366c011ec0 con 0x7f36640bff00 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f366c0e7510 con 0x7f36781083c0 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f367e4e5640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] conn(0x7f36640bff00 0x7f36640c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.848+0000 7f367dce4640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36640b6770 0x7f36640b8c80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36740058c0 tx=0x7f367400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.849+0000 7f367e4e5640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] conn(0x7f36640bff00 0x7f36640c2350 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.849+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== osd.3 v2:172.21.15.60:6810/1306706740 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f366c011ec0 con 0x7f36640bff00 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 --> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3678063fd0 con 0x7f36640bff00 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f366affd640 1 -- 172.21.15.60:0/2722155623 <== osd.3 v2:172.21.15.60:6810/1306706740 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3678063fd0 con 0x7f36640bff00 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] conn(0x7f36640bff00 msgr2=0x7f36640c2350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] conn(0x7f36640bff00 0x7f36640c2350 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36640b6770 msgr2=0x7f36640b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f36640b6770 0x7f36640b8c80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36740058c0 tx=0x7f367400a2d0 comp rx=0 tx=0).stop 2024-09-21T07:33:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36781083c0 msgr2=0x7f367819aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 --2- 172.21.15.60:0/2722155623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36781083c0 0x7f367819aa10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f366c00c970 tx=0x7f366c00ce30 comp rx=0 tx=0).stop 2024-09-21T07:33:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367e4e5640 1 -- 172.21.15.60:0/2722155623 reap_dead start 2024-09-21T07:33:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 shutdown_connections 2024-09-21T07:33:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 >> 172.21.15.60:0/2722155623 conn(0x7f3678079740 msgr2=0x7f3678104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 shutdown_connections 2024-09-21T07:33:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:32.864+0000 7f367ff48640 1 -- 172.21.15.60:0/2722155623 wait complete. 2024-09-21T07:33:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:35 smithi187 ceph-mon[34367]: pgmap v307: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T07:33:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:35 smithi123 ceph-mon[34166]: pgmap v307: 97 pgs: 5 peering, 92 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T07:33:36.775 INFO:teuthology.orchestra.run.smithi060.stdout:107374182460 2024-09-21T07:33:36.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T07:33:36.985 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:37.817 INFO:teuthology.orchestra.run.smithi060.stdout:154618822707 2024-09-21T07:33:37.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T07:33:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:37 smithi060 ceph-mon[31244]: pgmap v308: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 7.8 KiB/s, 0 objects/s recovering 2024-09-21T07:33:38.208 INFO:teuthology.orchestra.run.smithi060.stdout:197568495658 2024-09-21T07:33:38.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T07:33:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:37 smithi187 ceph-mon[34367]: pgmap v308: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 7.8 KiB/s, 0 objects/s recovering 2024-09-21T07:33:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:37 smithi123 ceph-mon[34166]: pgmap v308: 97 pgs: 4 peering, 93 active+clean; 643 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 7.8 KiB/s, 0 objects/s recovering 2024-09-21T07:33:38.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.358+0000 7f6a90a9e640 1 -- 172.21.15.60:0/911562442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 msgr2=0x7f6a8c102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.358+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/911562442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c102ed0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009900 tx=0x7f6a7c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 -- 172.21.15.60:0/911562442 shutdown_connections 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/911562442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c108d00 0x7f6a8c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/911562442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a8c1083b0 0x7f6a8c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/911562442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c102ed0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 -- 172.21.15.60:0/911562442 >> 172.21.15.60:0/911562442 conn(0x7f6a8c079790 msgr2=0x7f6a8c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 -- 172.21.15.60:0/911562442 shutdown_connections 2024-09-21T07:33:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 -- 172.21.15.60:0/911562442 wait complete. 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.359+0000 7f6a90a9e640 1 Processor -- start 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 -- start start 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c0ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c1083b0 0x7f6a8c0ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a8c108d00 0x7f6a8c1000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c112a20 con 0x7f6a8c102ac0 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c1128a0 con 0x7f6a8c108d00 2024-09-21T07:33:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a90a9e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8c112ba0 con 0x7f6a8c1083b0 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a8a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c0ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a8a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c0ff650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57638/0 (socket says 172.21.15.60:57638) 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a8a59c640 1 -- 172.21.15.60:0/2383334860 learned_addr learned my addr 172.21.15.60:0/2383334860 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a89d9b640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c1083b0 0x7f6a8c0ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a8a59c640 1 -- 172.21.15.60:0/2383334860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c1083b0 msgr2=0x7f6a8c0ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.360+0000 7f6a8a59c640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c1083b0 0x7f6a8c0ffb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a8a59c640 1 -- 172.21.15.60:0/2383334860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a8c108d00 msgr2=0x7f6a8c1000d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a8a59c640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a8c108d00 0x7f6a8c1000d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a8a59c640 1 -- 172.21.15.60:0/2383334860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8c1a8880 con 0x7f6a8c102ac0 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a8a59c640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c0ff650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c005940 tx=0x7f6a7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c03f030 con 0x7f6a8c102ac0 2024-09-21T07:33:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a7c003cb0 con 0x7f6a8c102ac0 2024-09-21T07:33:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8c1a8b10 con 0x7f6a8c102ac0 2024-09-21T07:33:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c035070 con 0x7f6a8c102ac0 2024-09-21T07:33:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.361+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a8c1a9040 con 0x7f6a8c102ac0 2024-09-21T07:33:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.362+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a8c063b50 con 0x7f6a8c102ac0 2024-09-21T07:33:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.366+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6a7c042030 con 0x7f6a8c102ac0 2024-09-21T07:33:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.366+0000 7f6a7b7fe640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a740b6620 0x7f6a740b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.366+0000 7f6a89d9b640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a740b6620 0x7f6a740b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.366+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f6a7c108300 con 0x7f6a8c102ac0 2024-09-21T07:33:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.367+0000 7f6a7b7fe640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] conn(0x7f6a740c0090 0x7f6a740c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.367+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 --> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a740c2c50 con 0x7f6a740c0090 2024-09-21T07:33:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.367+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f6a7c108750 con 0x7f6a8c102ac0 2024-09-21T07:33:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.367+0000 7f6a8ad9d640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] conn(0x7f6a740c0090 0x7f6a740c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.367+0000 7f6a89d9b640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a740b6620 0x7f6a740b8b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c079c50 tx=0x7f6a8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.367+0000 7f6a8ad9d640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] conn(0x7f6a740c0090 0x7f6a740c2580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:38.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.368+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== osd.0 v2:172.21.15.60:6802/331796551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a740c2c50 con 0x7f6a740c0090 2024-09-21T07:33:38.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 --> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a8c063f50 con 0x7f6a740c0090 2024-09-21T07:33:38.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a7b7fe640 1 -- 172.21.15.60:0/2383334860 <== osd.0 v2:172.21.15.60:6802/331796551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6a8c063f50 con 0x7f6a740c0090 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] conn(0x7f6a740c0090 msgr2=0x7f6a740c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] conn(0x7f6a740c0090 0x7f6a740c2580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a740b6620 msgr2=0x7f6a740b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f6a740b6620 0x7f6a740b8b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c079c50 tx=0x7f6a8000b390 comp rx=0 tx=0).stop 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 msgr2=0x7f6a8c0ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a90a9e640 1 --2- 172.21.15.60:0/2383334860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8c102ac0 0x7f6a8c0ff650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c005940 tx=0x7f6a7c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.382+0000 7f6a8ad9d640 1 -- 172.21.15.60:0/2383334860 reap_dead start 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.383+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 shutdown_connections 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.383+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 >> 172.21.15.60:0/2383334860 conn(0x7f6a8c079790 msgr2=0x7f6a8c101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.383+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 shutdown_connections 2024-09-21T07:33:38.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:38.383+0000 7f6a90a9e640 1 -- 172.21.15.60:0/2383334860 wait complete. 2024-09-21T07:33:39.006 INFO:teuthology.orchestra.run.smithi060.stdout:34359738444 2024-09-21T07:33:39.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T07:33:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 -- 172.21.15.60:0/883953268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40109df0 msgr2=0x7f9b40110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/883953268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40109df0 0x7f9b40110620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009ca0 tx=0x7f9b3802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 -- 172.21.15.60:0/883953268 shutdown_connections 2024-09-21T07:33:39.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/883953268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40109df0 0x7f9b40110620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/883953268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b401094a0 0x7f9b401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/883953268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b40103b60 0x7f9b40103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 -- 172.21.15.60:0/883953268 >> 172.21.15.60:0/883953268 conn(0x7f9b4007b850 msgr2=0x7f9b4007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 -- 172.21.15.60:0/883953268 shutdown_connections 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.554+0000 7f9b46c9e640 1 -- 172.21.15.60:0/883953268 wait complete. 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.555+0000 7f9b46c9e640 1 Processor -- start 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.555+0000 7f9b46c9e640 1 -- start start 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b46c9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40103b60 0x7f9b4019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b46c9e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b401094a0 0x7f9b4019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b46c9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b40109df0 0x7f9b4019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b46c9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113ab0 con 0x7f9b40103b60 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b46c9e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113930 con 0x7f9b40109df0 2024-09-21T07:33:39.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b46c9e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113c30 con 0x7f9b401094a0 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40103b60 0x7f9b4019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40103b60 0x7f9b4019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57658/0 (socket says 172.21.15.60:57658) 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 -- 172.21.15.60:0/2875181301 learned_addr learned my addr 172.21.15.60:0/2875181301 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b4523b640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b40109df0 0x7f9b4019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b3ffff640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b401094a0 0x7f9b4019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 -- 172.21.15.60:0/2875181301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b401094a0 msgr2=0x7f9b4019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b401094a0 0x7f9b4019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 -- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b40109df0 msgr2=0x7f9b4019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b40109df0 0x7f9b4019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 -- 172.21.15.60:0/2875181301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b401a0350 con 0x7f9b40103b60 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b3ffff640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b401094a0 0x7f9b4019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.556+0000 7f9b44a3a640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40103b60 0x7f9b4019a4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c890 tx=0x7f9b3400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.557+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34004220 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.557+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b340043c0 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.557+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b401a0640 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.557+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34004a00 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.557+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b401a6e60 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.558+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b40063b50 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.559+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9b340079b0 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.560+0000 7f9b3dffb640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9b300b65d0 0x7f9b300b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.560+0000 7f9b3ffff640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9b300b65d0 0x7f9b300b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.560+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f9b340e7210 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.560+0000 7f9b3dffb640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] conn(0x7f9b300c0040 0x7f9b300c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.560+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 --> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b300c2c00 con 0x7f9b300c0040 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.560+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9b340ee050 con 0x7f9b40103b60 2024-09-21T07:33:39.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.561+0000 7f9b3ffff640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9b300b65d0 0x7f9b300b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005e10 tx=0x7f9b2c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.561+0000 7f9b4523b640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] conn(0x7f9b300c0040 0x7f9b300c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:39.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.561+0000 7f9b4523b640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] conn(0x7f9b300c0040 0x7f9b300c2530 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:39.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.562+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== osd.4 v2:172.21.15.123:6808/3197471804 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b300c2c00 con 0x7f9b300c0040 2024-09-21T07:33:39.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.576+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 --> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b40063fd0 con 0x7f9b300c0040 2024-09-21T07:33:39.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b3dffb640 1 -- 172.21.15.60:0/2875181301 <== osd.4 v2:172.21.15.123:6808/3197471804 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9b40063fd0 con 0x7f9b300c0040 2024-09-21T07:33:39.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] conn(0x7f9b300c0040 msgr2=0x7f9b300c2530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] conn(0x7f9b300c0040 0x7f9b300c2530 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9b300b65d0 msgr2=0x7f9b300b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f9b300b65d0 0x7f9b300b8ae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005e10 tx=0x7f9b2c005da0 comp rx=0 tx=0).stop 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40103b60 msgr2=0x7f9b4019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b46c9e640 1 --2- 172.21.15.60:0/2875181301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b40103b60 0x7f9b4019a4a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c890 tx=0x7f9b3400cd50 comp rx=0 tx=0).stop 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.577+0000 7f9b4523b640 1 -- 172.21.15.60:0/2875181301 reap_dead start 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.578+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 shutdown_connections 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.578+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 >> 172.21.15.60:0/2875181301 conn(0x7f9b4007b850 msgr2=0x7f9b401054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.578+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 shutdown_connections 2024-09-21T07:33:39.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:39.578+0000 7f9b46c9e640 1 -- 172.21.15.60:0/2875181301 wait complete. 2024-09-21T07:33:40.078 INFO:teuthology.orchestra.run.smithi060.stdout:292057776150 2024-09-21T07:33:40.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T07:33:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:39 smithi187 ceph-mon[34367]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 7.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:40.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:39 smithi123 ceph-mon[34166]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 7.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:39 smithi060 ceph-mon[31244]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 7.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:40.582 INFO:teuthology.orchestra.run.smithi060.stdout:266287972378 2024-09-21T07:33:40.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T07:33:41.043 INFO:teuthology.orchestra.run.smithi060.stdout:73014444099 2024-09-21T07:33:41.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T07:33:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:41.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2650820799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e4108d20 msgr2=0x7ff2e410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2650820799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e4108d20 0x7ff2e410f550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009ca0 tx=0x7ff2dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2650820799 shutdown_connections 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2650820799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e4108d20 0x7ff2e410f550 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2650820799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e41083d0 0x7ff2e41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2650820799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e4102ae0 0x7ff2e4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2650820799 >> 172.21.15.60:0/2650820799 conn(0x7ff2e40797b0 msgr2=0x7ff2e4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2650820799 shutdown_connections 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.717+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2650820799 wait complete. 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 Processor -- start 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 -- start start 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4102ae0 0x7ff2e40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e41083d0 0x7ff2e40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e4108d20 0x7ff2e41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e41129e0 con 0x7ff2e41083d0 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4112860 con 0x7ff2e4108d20 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2eabd1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4112b60 con 0x7ff2e4102ae0 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e41083d0 0x7ff2e40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e41083d0 0x7ff2e40ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57668/0 (socket says 172.21.15.60:57668) 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.718+0000 7ff2e3fff640 1 -- 172.21.15.60:0/2955063094 learned_addr learned my addr 172.21.15.60:0/2955063094 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e896d640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4102ae0 0x7ff2e40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e916e640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e4108d20 0x7ff2e41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e3fff640 1 -- 172.21.15.60:0/2955063094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4102ae0 msgr2=0x7ff2e40ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e3fff640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4102ae0 0x7ff2e40ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e3fff640 1 -- 172.21.15.60:0/2955063094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e4108d20 msgr2=0x7ff2e41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e3fff640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e4108d20 0x7ff2e41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e3fff640 1 -- 172.21.15.60:0/2955063094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e41a8700 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e916e640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e4108d20 0x7ff2e41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e3fff640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e41083d0 0x7ff2e40ffbb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800e9c0 tx=0x7ff2d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800ccc0 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2d80054d0 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e41a89f0 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8010430 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.719+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e41a8ee0 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.720+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2e4063b50 con 0x7ff2e41083d0 2024-09-21T07:33:41.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.722+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff2d8005000 con 0x7ff2e41083d0 2024-09-21T07:33:41.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e1ffb640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e896d640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7ff2d80e7d10 con 0x7ff2e41083d0 2024-09-21T07:33:41.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e1ffb640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] conn(0x7ff2cc0c0010 0x7ff2cc0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 --> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2d800be50 con 0x7ff2cc0c0010 2024-09-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff2d80e8160 con 0x7ff2e41083d0 2024-09-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e916e640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] conn(0x7ff2cc0c0010 0x7ff2cc0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.723+0000 7ff2e896d640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2e41010c0 tx=0x7ff2d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.724+0000 7ff2e916e640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] conn(0x7ff2cc0c0010 0x7ff2cc0c2500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.724+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== osd.9 v2:172.21.15.60:6826/81256373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2d800be50 con 0x7ff2cc0c0010 2024-09-21T07:33:41.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.739+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 --> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2e4063fd0 con 0x7ff2cc0c0010 2024-09-21T07:33:41.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.739+0000 7ff2e1ffb640 1 -- 172.21.15.60:0/2955063094 <== osd.9 v2:172.21.15.60:6826/81256373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff2e4063fd0 con 0x7ff2cc0c0010 2024-09-21T07:33:41.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.739+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] conn(0x7ff2cc0c0010 msgr2=0x7ff2cc0c2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.739+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] conn(0x7ff2cc0c0010 0x7ff2cc0c2500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:41.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff2cc0b65a0 msgr2=0x7ff2cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff2cc0b65a0 0x7ff2cc0b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2e41010c0 tx=0x7ff2d4005f90 comp rx=0 tx=0).stop 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e41083d0 msgr2=0x7ff2e40ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 --2- 172.21.15.60:0/2955063094 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2e41083d0 0x7ff2e40ffbb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800e9c0 tx=0x7ff2d800ee80 comp rx=0 tx=0).stop 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2e916e640 1 -- 172.21.15.60:0/2955063094 reap_dead start 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 shutdown_connections 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 >> 172.21.15.60:0/2955063094 conn(0x7ff2e40797b0 msgr2=0x7ff2e4101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 shutdown_connections 2024-09-21T07:33:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:41.740+0000 7ff2eabd1640 1 -- 172.21.15.60:0/2955063094 wait complete. 2024-09-21T07:33:42.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 -- 172.21.15.60:0/1385978739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c102a60 msgr2=0x7feb8c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 --2- 172.21.15.60:0/1385978739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c102a60 0x7feb8c102e70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009900 tx=0x7feb7c02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 -- 172.21.15.60:0/1385978739 shutdown_connections 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 --2- 172.21.15.60:0/1385978739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8c108cf0 0x7feb8c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 --2- 172.21.15.60:0/1385978739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c1083a0 0x7feb8c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 --2- 172.21.15.60:0/1385978739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c102a60 0x7feb8c102e70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 -- 172.21.15.60:0/1385978739 >> 172.21.15.60:0/1385978739 conn(0x7feb8c079730 msgr2=0x7feb8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 -- 172.21.15.60:0/1385978739 shutdown_connections 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.126+0000 7feb910ce640 1 -- 172.21.15.60:0/1385978739 wait complete. 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 Processor -- start 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 -- start start 2024-09-21T07:33:42.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c102a60 0x7feb8c199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1083a0 0x7feb8c199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8c108cf0 0x7feb8c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c112960 con 0x7feb8c1083a0 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1127e0 con 0x7feb8c102a60 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb910ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c112ae0 con 0x7feb8c108cf0 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1083a0 0x7feb8c199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1083a0 0x7feb8c199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57698/0 (socket says 172.21.15.60:57698) 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.127+0000 7feb8a59c640 1 -- 172.21.15.60:0/2418818692 learned_addr learned my addr 172.21.15.60:0/2418818692 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8ad9d640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c102a60 0x7feb8c199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8b59e640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8c108cf0 0x7feb8c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8a59c640 1 -- 172.21.15.60:0/2418818692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8c108cf0 msgr2=0x7feb8c199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8a59c640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8c108cf0 0x7feb8c199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8a59c640 1 -- 172.21.15.60:0/2418818692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c102a60 msgr2=0x7feb8c199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8a59c640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c102a60 0x7feb8c199000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8a59c640 1 -- 172.21.15.60:0/2418818692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1a8680 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8ad9d640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c102a60 0x7feb8c199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb8a59c640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1083a0 0x7feb8c199540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c970 tx=0x7feb8000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80014070 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb80004440 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1a8910 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80003e50 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.128+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1a8e50 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.129+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb8c063b50 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.131+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7feb80017070 con 0x7feb8c1083a0 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.131+0000 7feb73fff640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feb740b6740 0x7feb740b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb8ad9d640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feb740b6740 0x7feb740b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7feb800e7610 con 0x7feb8c1083a0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb73fff640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] conn(0x7feb740c01b0 0x7feb740c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 --> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb8000fe50 con 0x7feb740c01b0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7feb800e79c0 con 0x7feb8c1083a0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb8b59e640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] conn(0x7feb740c01b0 0x7feb740c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.132+0000 7feb8ad9d640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feb740b6740 0x7feb740b8c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb7c000c00 tx=0x7feb7c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.133+0000 7feb8b59e640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] conn(0x7feb740c01b0 0x7feb740c26a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:42.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.133+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== osd.6 v2:172.21.15.60:6818/3398529627 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb8000fe50 con 0x7feb740c01b0 2024-09-21T07:33:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.147+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 --> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb8c063f50 con 0x7feb740c01b0 2024-09-21T07:33:42.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb73fff640 1 -- 172.21.15.60:0/2418818692 <== osd.6 v2:172.21.15.60:6818/3398529627 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feb8c063f50 con 0x7feb740c01b0 2024-09-21T07:33:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] conn(0x7feb740c01b0 msgr2=0x7feb740c26a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] conn(0x7feb740c01b0 0x7feb740c26a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feb740b6740 msgr2=0x7feb740b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feb740b6740 0x7feb740b8c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb7c000c00 tx=0x7feb7c009680 comp rx=0 tx=0).stop 2024-09-21T07:33:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1083a0 msgr2=0x7feb8c199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:42.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 --2- 172.21.15.60:0/2418818692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1083a0 0x7feb8c199540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c970 tx=0x7feb8000ce30 comp rx=0 tx=0).stop 2024-09-21T07:33:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb8b59e640 1 -- 172.21.15.60:0/2418818692 reap_dead start 2024-09-21T07:33:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 shutdown_connections 2024-09-21T07:33:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.148+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 >> 172.21.15.60:0/2418818692 conn(0x7feb8c079730 msgr2=0x7feb8c1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.149+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 shutdown_connections 2024-09-21T07:33:42.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:42.149+0000 7feb910ce640 1 -- 172.21.15.60:0/2418818692 wait complete. 2024-09-21T07:33:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:41 smithi187 ceph-mon[34367]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 7.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:41 smithi123 ceph-mon[34166]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 7.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:41 smithi060 ceph-mon[31244]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 7.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:42.700 INFO:teuthology.orchestra.run.smithi060.stdout:128849018937 2024-09-21T07:33:42.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T07:33:43.590 INFO:teuthology.orchestra.run.smithi060.stdout:244813135904 2024-09-21T07:33:43.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T07:33:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 -- 172.21.15.60:0/3892012613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79941094d0 msgr2=0x7f79941098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 --2- 172.21.15.60:0/3892012613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79941094d0 0x7f79941098e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7984009900 tx=0x7f798402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 -- 172.21.15.60:0/3892012613 shutdown_connections 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 --2- 172.21.15.60:0/3892012613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 0x7f7994110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 --2- 172.21.15.60:0/3892012613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79941094d0 0x7f79941098e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 --2- 172.21.15.60:0/3892012613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7994103b90 0x7f7994103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 -- 172.21.15.60:0/3892012613 >> 172.21.15.60:0/3892012613 conn(0x7f79940ff600 msgr2=0x7f7994101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 -- 172.21.15.60:0/3892012613 shutdown_connections 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.732+0000 7f799be1c640 1 -- 172.21.15.60:0/3892012613 wait complete. 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 Processor -- start 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 -- start start 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 0x7f799419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79941094d0 0x7f799419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 0x7f799419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7994113ae0 con 0x7f7994103b90 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7994113960 con 0x7f7994109e20 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.733+0000 7f799be1c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7994113c60 con 0x7f79941094d0 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 0x7f799419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 0x7f799419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57712/0 (socket says 172.21.15.60:57712) 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 -- 172.21.15.60:0/356873565 learned_addr learned my addr 172.21.15.60:0/356873565 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f79993b7640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79941094d0 0x7f799419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f799a3b9640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 0x7f799419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 -- 172.21.15.60:0/356873565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79941094d0 msgr2=0x7f799419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79941094d0 0x7f799419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 -- 172.21.15.60:0/356873565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 msgr2=0x7f799419fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 0x7f799419fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 -- 172.21.15.60:0/356873565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79941a0420 con 0x7f7994103b90 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f799a3b9640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 0x7f799419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f7999bb8640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 0x7f799419a4b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f799000d770 tx=0x7f799000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990017070 con 0x7f7994103b90 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79900054d0 con 0x7f7994103b90 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79941a0710 con 0x7f7994103b90 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.734+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990004c30 con 0x7f7994103b90 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.735+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79941a6e70 con 0x7f7994103b90 2024-09-21T07:33:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.736+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7994104e10 con 0x7f7994103b90 2024-09-21T07:33:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.738+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7990004dd0 con 0x7f7994103b90 2024-09-21T07:33:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.739+0000 7f798affd640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f79800b65a0 0x7f79800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.739+0000 7f79993b7640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f79800b65a0 0x7f79800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.739+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f79900e73a0 con 0x7f7994103b90 2024-09-21T07:33:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.740+0000 7f79993b7640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f79800b65a0 0x7f79800b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7984009230 tx=0x7f7984031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.741+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79900adaa0 con 0x7f7994103b90 2024-09-21T07:33:43.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.935+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f799410bbf0 con 0x7f7994103b90 2024-09-21T07:33:43.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.935+0000 7f798affd640 1 -- 172.21.15.60:0/356873565 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79900b1e80 con 0x7f7994103b90 2024-09-21T07:33:43.937 INFO:teuthology.orchestra.run.smithi060.stdout:51539607626 2024-09-21T07:33:43.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.937+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f79800b65a0 msgr2=0x7f79800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.937+0000 7f799be1c640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f79800b65a0 0x7f79800b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7984009230 tx=0x7f7984031400 comp rx=0 tx=0).stop 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.937+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 msgr2=0x7f799419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.937+0000 7f799be1c640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 0x7f799419a4b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f799000d770 tx=0x7f799000dc30 comp rx=0 tx=0).stop 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.937+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 shutdown_connections 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f79800b65a0 0x7f79800b8ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7994109e20 0x7f799419fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79941094d0 0x7f799419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 --2- 172.21.15.60:0/356873565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7994103b90 0x7f799419a4b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 >> 172.21.15.60:0/356873565 conn(0x7f79940ff600 msgr2=0x7f7994101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 shutdown_connections 2024-09-21T07:33:43.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:43.938+0000 7f799be1c640 1 -- 172.21.15.60:0/356873565 wait complete. 2024-09-21T07:33:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:43 smithi187 ceph-mon[34367]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 6.5 KiB/s, 1 objects/s recovering 2024-09-21T07:33:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:43 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/356873565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:33:44.325 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:43 smithi123 ceph-mon[34166]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 6.5 KiB/s, 1 objects/s recovering 2024-09-21T07:33:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:43 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/356873565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:33:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:43 smithi060 ceph-mon[31244]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 6.5 KiB/s, 1 objects/s recovering 2024-09-21T07:33:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:43 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/356873565' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:33:44.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 -- 172.21.15.60:0/329043839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead41094d0 msgr2=0x7fead41098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 --2- 172.21.15.60:0/329043839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead41094d0 0x7fead41098e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feac8009900 tx=0x7feac802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:44.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 -- 172.21.15.60:0/329043839 shutdown_connections 2024-09-21T07:33:44.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 --2- 172.21.15.60:0/329043839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead4109e20 0x7fead4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 --2- 172.21.15.60:0/329043839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead41094d0 0x7fead41098e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 --2- 172.21.15.60:0/329043839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fead4103b90 0x7fead4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 -- 172.21.15.60:0/329043839 >> 172.21.15.60:0/329043839 conn(0x7fead40ff600 msgr2=0x7fead4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:44.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 -- 172.21.15.60:0/329043839 shutdown_connections 2024-09-21T07:33:44.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.962+0000 7feadac27640 1 -- 172.21.15.60:0/329043839 wait complete. 2024-09-21T07:33:44.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 Processor -- start 2024-09-21T07:33:44.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 -- start start 2024-09-21T07:33:44.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead4103b90 0x7fead419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fead41094d0 0x7fead419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 0x7fead419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fead4113ae0 con 0x7fead4109e20 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fead4113960 con 0x7fead41094d0 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.963+0000 7feadac27640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fead4113c60 con 0x7fead4103b90 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 0x7fead419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 0x7fead419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57730/0 (socket says 172.21.15.60:57730) 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 -- 172.21.15.60:0/2637711900 learned_addr learned my addr 172.21.15.60:0/2637711900 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead89c3640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead4103b90 0x7fead419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead3fff640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fead41094d0 0x7fead419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 -- 172.21.15.60:0/2637711900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead4103b90 msgr2=0x7fead419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead4103b90 0x7fead419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 -- 172.21.15.60:0/2637711900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fead41094d0 msgr2=0x7fead419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fead41094d0 0x7fead419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 -- 172.21.15.60:0/2637711900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead41a0480 con 0x7fead4109e20 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead91c4640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 0x7fead419fd50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feacc00eb10 tx=0x7feacc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc004b20 con 0x7fead4109e20 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead41a0770 con 0x7fead4109e20 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feacc004cc0 con 0x7fead4109e20 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.964+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc010690 con 0x7fead4109e20 2024-09-21T07:33:44.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.965+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead41a6ed0 con 0x7fead4109e20 2024-09-21T07:33:44.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.966+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead4103fa0 con 0x7fead4109e20 2024-09-21T07:33:44.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.967+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7feacc005000 con 0x7fead4109e20 2024-09-21T07:33:44.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.968+0000 7fead1ffb640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feabc0b65a0 0x7feabc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:44.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.968+0000 7fead89c3640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feabc0b65a0 0x7feabc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:44.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.968+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7feacc0e7bb0 con 0x7fead4109e20 2024-09-21T07:33:44.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.968+0000 7fead89c3640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feabc0b65a0 0x7feabc0b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feac4005d00 tx=0x7feac400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:44.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:44.971+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feacc056710 con 0x7fead4109e20 2024-09-21T07:33:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.161+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fead419b640 con 0x7fead4109e20 2024-09-21T07:33:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.161+0000 7fead1ffb640 1 -- 172.21.15.60:0/2637711900 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fead419b640 con 0x7fead4109e20 2024-09-21T07:33:45.163 INFO:teuthology.orchestra.run.smithi060.stdout:107374182462 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feabc0b65a0 msgr2=0x7feabc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feabc0b65a0 0x7feabc0b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feac4005d00 tx=0x7feac400b410 comp rx=0 tx=0).stop 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 msgr2=0x7fead419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 0x7fead419fd50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7feacc00eb10 tx=0x7feacc00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 shutdown_connections 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7feabc0b65a0 0x7feabc0b8ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fead4109e20 0x7fead419fd50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fead41094d0 0x7fead419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 --2- 172.21.15.60:0/2637711900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead4103b90 0x7fead419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 >> 172.21.15.60:0/2637711900 conn(0x7fead40ff600 msgr2=0x7fead4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 shutdown_connections 2024-09-21T07:33:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:45.164+0000 7feadac27640 1 -- 172.21.15.60:0/2637711900 wait complete. 2024-09-21T07:33:45.293 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607624 got 51539607626 for osd.1 2024-09-21T07:33:45.293 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:45.889 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182462 for osd.3 2024-09-21T07:33:45.890 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:45 smithi060 ceph-mon[31244]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 5.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:46.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:45 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2637711900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:33:46.252 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.257 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.257 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:45 smithi187 ceph-mon[34367]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 5.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:45 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2637711900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:33:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.306 INFO:teuthology.orchestra.run.smithi060.stdout:176093659183 2024-09-21T07:33:46.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T07:33:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.336 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:45 smithi123 ceph-mon[34166]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s; 5.9 KiB/s, 1 objects/s recovering 2024-09-21T07:33:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:45 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2637711900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:33:47.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 -- 172.21.15.60:0/4010091832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698103b60 msgr2=0x7fc698103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/4010091832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698103b60 0x7fc698103f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc688009900 tx=0x7fc68802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:47.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 -- 172.21.15.60:0/4010091832 shutdown_connections 2024-09-21T07:33:47.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/4010091832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc698109df0 0x7fc698110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/4010091832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6981094a0 0x7fc6981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/4010091832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698103b60 0x7fc698103f70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 -- 172.21.15.60:0/4010091832 >> 172.21.15.60:0/4010091832 conn(0x7fc69807b850 msgr2=0x7fc69807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 -- 172.21.15.60:0/4010091832 shutdown_connections 2024-09-21T07:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.045+0000 7fc69dd3b640 1 -- 172.21.15.60:0/4010091832 wait complete. 2024-09-21T07:33:47.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 Processor -- start 2024-09-21T07:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 -- start start 2024-09-21T07:33:47.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc698103b60 0x7fc69819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6981094a0 0x7fc69819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 0x7fc69819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc698113b70 con 0x7fc698109df0 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6981139f0 con 0x7fc6981094a0 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc69dd3b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc698113cf0 con 0x7fc698103b60 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc697fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 0x7fc69819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc697fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 0x7fc69819fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48516/0 (socket says 172.21.15.60:48516) 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc697fff640 1 -- 172.21.15.60:0/3040732102 learned_addr learned my addr 172.21.15.60:0/3040732102 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.046+0000 7fc6977fe640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc698103b60 0x7fc69819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc696ffd640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6981094a0 0x7fc69819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc697fff640 1 -- 172.21.15.60:0/3040732102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc698103b60 msgr2=0x7fc69819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc697fff640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc698103b60 0x7fc69819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc697fff640 1 -- 172.21.15.60:0/3040732102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6981094a0 msgr2=0x7fc69819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc697fff640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6981094a0 0x7fc69819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc697fff640 1 -- 172.21.15.60:0/3040732102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6981a05b0 con 0x7fc698109df0 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc696ffd640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6981094a0 0x7fc69819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc697fff640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 0x7fc69819fe80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc69000b970 tx=0x7fc69000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690019070 con 0x7fc698109df0 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6981a08a0 con 0x7fc698109df0 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc690014440 con 0x7fc698109df0 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6900075d0 con 0x7fc698109df0 2024-09-21T07:33:47.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.047+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6981a7000 con 0x7fc698109df0 2024-09-21T07:33:47.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.048+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc698103ff0 con 0x7fc698109df0 2024-09-21T07:33:47.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.050+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc69001c070 con 0x7fc698109df0 2024-09-21T07:33:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.051+0000 7fc694ff9640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc6800b65a0 0x7fc6800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.051+0000 7fc6977fe640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc6800b65a0 0x7fc6800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.051+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fc6900e6ef0 con 0x7fc698109df0 2024-09-21T07:33:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.051+0000 7fc6977fe640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc6800b65a0 0x7fc6800b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc688031440 tx=0x7fc688031c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:47.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.054+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6900ad5f0 con 0x7fc698109df0 2024-09-21T07:33:47.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.248+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc69802e640 con 0x7fc698109df0 2024-09-21T07:33:47.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.248+0000 7fc694ff9640 1 -- 172.21.15.60:0/3040732102 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc6900b19d0 con 0x7fc698109df0 2024-09-21T07:33:47.250 INFO:teuthology.orchestra.run.smithi060.stdout:223338299430 2024-09-21T07:33:47.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc6800b65a0 msgr2=0x7fc6800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc6800b65a0 0x7fc6800b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc688031440 tx=0x7fc688031c90 comp rx=0 tx=0).stop 2024-09-21T07:33:47.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 msgr2=0x7fc69819fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 0x7fc69819fe80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc69000b970 tx=0x7fc69000be30 comp rx=0 tx=0).stop 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 shutdown_connections 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc6800b65a0 0x7fc6800b8ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc698109df0 0x7fc69819fe80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6981094a0 0x7fc69819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 --2- 172.21.15.60:0/3040732102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc698103b60 0x7fc69819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.250+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 >> 172.21.15.60:0/3040732102 conn(0x7fc69807b850 msgr2=0x7fc6981076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.251+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 shutdown_connections 2024-09-21T07:33:47.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.251+0000 7fc69dd3b640 1 -- 172.21.15.60:0/3040732102 wait complete. 2024-09-21T07:33:47.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 -- 172.21.15.60:0/781487331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73601049d0 msgr2=0x7f7360104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 --2- 172.21.15.60:0/781487331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73601049d0 0x7f7360104de0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f735c009900 tx=0x7f735c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:47.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 -- 172.21.15.60:0/781487331 shutdown_connections 2024-09-21T07:33:47.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 --2- 172.21.15.60:0/781487331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736010de30 0x7f7360110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 --2- 172.21.15.60:0/781487331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7360105320 0x7f736010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 --2- 172.21.15.60:0/781487331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73601049d0 0x7f7360104de0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.256+0000 7f73681f4640 1 -- 172.21.15.60:0/781487331 >> 172.21.15.60:0/781487331 conn(0x7f7360079740 msgr2=0x7f7360079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:47.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.257+0000 7f73681f4640 1 -- 172.21.15.60:0/781487331 shutdown_connections 2024-09-21T07:33:47.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.257+0000 7f73681f4640 1 -- 172.21.15.60:0/781487331 wait complete. 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 Processor -- start 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 -- start start 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73601049d0 0x7f736019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 0x7f736019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736010de30 0x7f736019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7360113ab0 con 0x7f7360105320 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7360113930 con 0x7f736010de30 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f73681f4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7360113c30 con 0x7f73601049d0 2024-09-21T07:33:47.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f736578f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 0x7f736019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f736578f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 0x7f736019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48534/0 (socket says 172.21.15.60:48534) 2024-09-21T07:33:47.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f736578f640 1 -- 172.21.15.60:0/1570119106 learned_addr learned my addr 172.21.15.60:0/1570119106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:47.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f7366791640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736010de30 0x7f736019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.258+0000 7f7365f90640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73601049d0 0x7f736019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f736578f640 1 -- 172.21.15.60:0/1570119106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73601049d0 msgr2=0x7f736019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f736578f640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73601049d0 0x7f736019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f736578f640 1 -- 172.21.15.60:0/1570119106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736010de30 msgr2=0x7f736019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f736578f640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736010de30 0x7f736019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f736578f640 1 -- 172.21.15.60:0/1570119106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73601a0450 con 0x7f7360105320 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f736578f640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 0x7f736019aa80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f735000e9c0 tx=0x7f735000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735000ccc0 con 0x7f7360105320 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73601a0740 con 0x7f7360105320 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73500054d0 con 0x7f7360105320 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350010430 con 0x7f7360105320 2024-09-21T07:33:47.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.259+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73601025f0 con 0x7f7360105320 2024-09-21T07:33:47.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.261+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7360104de0 con 0x7f7360105320 2024-09-21T07:33:47.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.262+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7350005000 con 0x7f7360105320 2024-09-21T07:33:47.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.263+0000 7f7356ffd640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f734c0b65a0 0x7f734c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:47.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.263+0000 7f7365f90640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f734c0b65a0 0x7f734c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:47.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.263+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f73500e7970 con 0x7f7360105320 2024-09-21T07:33:47.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.264+0000 7f7365f90640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f734c0b65a0 0x7f734c0b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f735c000c00 tx=0x7f735c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.268+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7350056710 con 0x7f7360105320 2024-09-21T07:33:47.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.463+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7360108f30 con 0x7f7360105320 2024-09-21T07:33:47.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.464+0000 7f7356ffd640 1 -- 172.21.15.60:0/1570119106 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f73500052f0 con 0x7f7360105320 2024-09-21T07:33:47.466 INFO:teuthology.orchestra.run.smithi060.stdout:292057776152 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f734c0b65a0 msgr2=0x7f734c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f734c0b65a0 0x7f734c0b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f735c000c00 tx=0x7f735c031400 comp rx=0 tx=0).stop 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 msgr2=0x7f736019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 0x7f736019aa80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f735000e9c0 tx=0x7f735000ee80 comp rx=0 tx=0).stop 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 shutdown_connections 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f734c0b65a0 0x7f734c0b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f736010de30 0x7f736019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7360105320 0x7f736019aa80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 --2- 172.21.15.60:0/1570119106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73601049d0 0x7f736019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:47.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 >> 172.21.15.60:0/1570119106 conn(0x7f7360079740 msgr2=0x7f73601008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:47.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 shutdown_connections 2024-09-21T07:33:47.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:47.466+0000 7f73681f4640 1 -- 172.21.15.60:0/1570119106 wait complete. 2024-09-21T07:33:47.807 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:48.205 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:47 smithi060 ceph-mon[31244]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 5.3 KiB/s, 1 objects/s recovering 2024-09-21T07:33:48.205 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:47 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3040732102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:33:48.205 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:47 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1570119106' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:33:48.242 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299427 got 223338299430 for osd.8 2024-09-21T07:33:48.242 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:47 smithi187 ceph-mon[34367]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 5.3 KiB/s, 1 objects/s recovering 2024-09-21T07:33:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:47 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3040732102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:33:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:47 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1570119106' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:33:48.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:47 smithi123 ceph-mon[34166]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 5.3 KiB/s, 1 objects/s recovering 2024-09-21T07:33:48.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:47 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3040732102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:33:48.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:47 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1570119106' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:33:48.669 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776150 got 292057776152 for osd.11 2024-09-21T07:33:48.669 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:49.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 -- 172.21.15.60:0/3774353124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 msgr2=0x7fee881087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 --2- 172.21.15.60:0/3774353124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee881087b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fee78009900 tx=0x7fee7802a410 comp rx=0 tx=0).stop 2024-09-21T07:33:49.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 -- 172.21.15.60:0/3774353124 shutdown_connections 2024-09-21T07:33:49.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 --2- 172.21.15.60:0/3774353124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88108cf0 0x7fee8810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 --2- 172.21.15.60:0/3774353124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee881087b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 --2- 172.21.15.60:0/3774353124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee88102a60 0x7fee88102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 -- 172.21.15.60:0/3774353124 >> 172.21.15.60:0/3774353124 conn(0x7fee88079730 msgr2=0x7fee88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 -- 172.21.15.60:0/3774353124 shutdown_connections 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.434+0000 7fee8feec640 1 -- 172.21.15.60:0/3774353124 wait complete. 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.435+0000 7fee8feec640 1 Processor -- start 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.435+0000 7fee8feec640 1 -- start start 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8feec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 0x7fee8819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8feec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee8819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8feec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee88108cf0 0x7fee8819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8feec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee88113a80 con 0x7fee881083a0 2024-09-21T07:33:49.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8feec640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fee88113900 con 0x7fee88102a60 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8feec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fee88113c00 con 0x7fee88108cf0 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8d487640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee8819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 0x7fee8819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8d487640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee8819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48556/0 (socket says 172.21.15.60:48556) 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 0x7fee8819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.60:52286/0 (socket says 172.21.15.60:52286) 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8d487640 1 -- 172.21.15.60:0/56246163 learned_addr learned my addr 172.21.15.60:0/56246163 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8e489640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee88108cf0 0x7fee8819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 -- 172.21.15.60:0/56246163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee88108cf0 msgr2=0x7fee8819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee88108cf0 0x7fee8819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 -- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 msgr2=0x7fee8819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee8819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 -- 172.21.15.60:0/56246163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee881a03a0 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8d487640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee8819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.436+0000 7fee8dc88640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 0x7fee8819a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee8400e9f0 tx=0x7fee8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.437+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8400ccc0 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.437+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee881a0690 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.437+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee840108e0 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.437+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84018880 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.437+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee881a6df0 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.438+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee88102e70 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.439+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fee84010430 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.440+0000 7fee7effd640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fee740b65a0 0x7fee740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.440+0000 7fee8d487640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fee740b65a0 0x7fee740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.440+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fee840e77a0 con 0x7fee88102a60 2024-09-21T07:33:49.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.441+0000 7fee8d487640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fee740b65a0 0x7fee740b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee780096c0 tx=0x7fee78032ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:49.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.445+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee840b22e0 con 0x7fee88102a60 2024-09-21T07:33:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.651+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fee8810a530 con 0x7fee88102a60 2024-09-21T07:33:49.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.652+0000 7fee7effd640 1 -- 172.21.15.60:0/56246163 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fee840b7220 con 0x7fee88102a60 2024-09-21T07:33:49.653 INFO:teuthology.orchestra.run.smithi060.stdout:266287972381 2024-09-21T07:33:49.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.655+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fee740b65a0 msgr2=0x7fee740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.655+0000 7fee8feec640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fee740b65a0 0x7fee740b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee780096c0 tx=0x7fee78032ed0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.655+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 msgr2=0x7fee8819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.655+0000 7fee8feec640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 0x7fee8819a430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee8400e9f0 tx=0x7fee8400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 shutdown_connections 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fee740b65a0 0x7fee740b8ab0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee88108cf0 0x7fee8819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee881083a0 0x7fee8819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 --2- 172.21.15.60:0/56246163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee88102a60 0x7fee8819a430 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 >> 172.21.15.60:0/56246163 conn(0x7fee88079730 msgr2=0x7fee88104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 shutdown_connections 2024-09-21T07:33:49.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.656+0000 7fee8feec640 1 -- 172.21.15.60:0/56246163 wait complete. 2024-09-21T07:33:50.022 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:49 smithi060 ceph-mon[31244]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 62 B/s, 0 objects/s recovering 2024-09-21T07:33:50.022 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:49 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:33:50.022 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:49 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/56246163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:33:50.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:49 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/620615770' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:33:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:49 smithi187 ceph-mon[34367]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 62 B/s, 0 objects/s recovering 2024-09-21T07:33:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:49 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:33:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:49 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/56246163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:33:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:49 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/620615770' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:33:50.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:49 smithi123 ceph-mon[34166]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 62 B/s, 0 objects/s recovering 2024-09-21T07:33:50.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:49 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:33:50.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:49 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/56246163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:33:50.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:49 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/620615770' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:33:50.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 -- 172.21.15.60:0/43657678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 msgr2=0x7f2f7810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 --2- 172.21.15.60:0/43657678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f7810f530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009ca0 tx=0x7f2f7002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 -- 172.21.15.60:0/43657678 shutdown_connections 2024-09-21T07:33:50.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 --2- 172.21.15.60:0/43657678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f7810f530 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 --2- 172.21.15.60:0/43657678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f781083b0 0x7f2f781087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 --2- 172.21.15.60:0/43657678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 0x7f2f78102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 -- 172.21.15.60:0/43657678 >> 172.21.15.60:0/43657678 conn(0x7f2f78079710 msgr2=0x7f2f78079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 -- 172.21.15.60:0/43657678 shutdown_connections 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.382+0000 7f2f7e380640 1 -- 172.21.15.60:0/43657678 wait complete. 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 Processor -- start 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 -- start start 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 0x7f2f78110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f781083b0 0x7f2f78110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f78110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113ae0 con 0x7f2f78108d00 2024-09-21T07:33:50.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113960 con 0x7f2f78102a70 2024-09-21T07:33:50.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7e380640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113c60 con 0x7f2f781083b0 2024-09-21T07:33:50.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7c91d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f78110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7c91d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f78110a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48578/0 (socket says 172.21.15.60:48578) 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f7c91d640 1 -- 172.21.15.60:0/2878200126 learned_addr learned my addr 172.21.15.60:0/2878200126 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f777fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f781083b0 0x7f2f78110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.383+0000 7f2f77fff640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 0x7f2f78110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7c91d640 1 -- 172.21.15.60:0/2878200126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f781083b0 msgr2=0x7f2f78110550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7c91d640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f781083b0 0x7f2f78110550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7c91d640 1 -- 172.21.15.60:0/2878200126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 msgr2=0x7f2f78110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7c91d640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 0x7f2f78110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7c91d640 1 -- 172.21.15.60:0/2878200126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f781a8710 con 0x7f2f78108d00 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f77fff640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 0x7f2f78110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:50.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7c91d640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f78110a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2f700098d0 tx=0x7f2f700317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70003b70 con 0x7f2f78108d00 2024-09-21T07:33:50.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f70003d10 con 0x7f2f78108d00 2024-09-21T07:33:50.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f781a89a0 con 0x7f2f78108d00 2024-09-21T07:33:50.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7002fa20 con 0x7f2f78108d00 2024-09-21T07:33:50.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.384+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f781a8ee0 con 0x7f2f78108d00 2024-09-21T07:33:50.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.385+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f78103cf0 con 0x7f2f78108d00 2024-09-21T07:33:50.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.388+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2f7002fbe0 con 0x7f2f78108d00 2024-09-21T07:33:50.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.389+0000 7f2f757fa640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2f600b65a0 0x7f2f600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.389+0000 7f2f77fff640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2f600b65a0 0x7f2f600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.389+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f2f701088f0 con 0x7f2f78108d00 2024-09-21T07:33:50.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.389+0000 7f2f77fff640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2f600b65a0 0x7f2f600b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f78111a60 tx=0x7f2f68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.392+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f700ceff0 con 0x7f2f78108d00 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 -- 172.21.15.60:0/484718243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 msgr2=0x7f3c50102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 --2- 172.21.15.60:0/484718243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50102e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009900 tx=0x7f3c4402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 -- 172.21.15.60:0/484718243 shutdown_connections 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 --2- 172.21.15.60:0/484718243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 0x7f3c5010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 --2- 172.21.15.60:0/484718243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c501083a0 0x7f3c501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 --2- 172.21.15.60:0/484718243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50102e70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.576+0000 7f3c58151640 1 -- 172.21.15.60:0/484718243 >> 172.21.15.60:0/484718243 conn(0x7f3c50079730 msgr2=0x7f3c50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.577+0000 7f3c58151640 1 -- 172.21.15.60:0/484718243 shutdown_connections 2024-09-21T07:33:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.577+0000 7f3c58151640 1 -- 172.21.15.60:0/484718243 wait complete. 2024-09-21T07:33:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.577+0000 7f3c58151640 1 Processor -- start 2024-09-21T07:33:50.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.577+0000 7f3c58151640 1 -- start start 2024-09-21T07:33:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c58151640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c58151640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c501083a0 0x7f3c50104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c58151640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 0x7f3c50104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c58151640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c501129b0 con 0x7f3c50102a60 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c58151640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50112830 con 0x7f3c50108cf0 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c58151640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50112b30 con 0x7f3c501083a0 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c55eed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c55eed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48596/0 (socket says 172.21.15.60:48596) 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c55eed640 1 -- 172.21.15.60:0/1427249341 learned_addr learned my addr 172.21.15.60:0/1427249341 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c556ec640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c501083a0 0x7f3c50104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 0x7f3c50104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 -- 172.21.15.60:0/1427249341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c501083a0 msgr2=0x7f3c50104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c501083a0 0x7f3c50104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 -- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 msgr2=0x7f3c50104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 -- 172.21.15.60:0/1427249341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c501a8730 con 0x7f3c50108cf0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c55eed640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.578+0000 7f3c566ee640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 0x7f3c50104cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009fd0 tx=0x7f3c4800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.579+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800ce20 con 0x7f3c50108cf0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.579+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c501a8a20 con 0x7f3c50108cf0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.579+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c48005020 con 0x7f3c50108cf0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.579+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48010690 con 0x7f3c50108cf0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.579+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c501a8f10 con 0x7f3c50108cf0 2024-09-21T07:33:50.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.580+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c50102e70 con 0x7f3c50108cf0 2024-09-21T07:33:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.581+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3c480054d0 con 0x7f3c50108cf0 2024-09-21T07:33:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.582+0000 7f3c42ffd640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3c3c0b65a0 0x7f3c3c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.582+0000 7f3c55eed640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3c3c0b65a0 0x7f3c3c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.582+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f3c480e7b70 con 0x7f3c50108cf0 2024-09-21T07:33:50.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.583+0000 7f3c55eed640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3c3c0b65a0 0x7f3c3c0b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3c44005ec0 tx=0x7f3c44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.586+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2f78111310 con 0x7f2f78108d00 2024-09-21T07:33:50.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.586+0000 7f2f757fa640 1 -- 172.21.15.60:0/2878200126 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f700d33d0 con 0x7f2f78108d00 2024-09-21T07:33:50.588 INFO:teuthology.orchestra.run.smithi060.stdout:154618822711 2024-09-21T07:33:50.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.586+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c480ae270 con 0x7f3c50108cf0 2024-09-21T07:33:50.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.589+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2f600b65a0 msgr2=0x7f2f600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.589+0000 7f2f7e380640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2f600b65a0 0x7f2f600b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f78111a60 tx=0x7f2f68005f90 comp rx=0 tx=0).stop 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 msgr2=0x7f2f78110a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f78110a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2f700098d0 tx=0x7f2f700317b0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 shutdown_connections 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2f600b65a0 0x7f2f600b8ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f78108d00 0x7f2f78110a90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f781083b0 0x7f2f78110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 --2- 172.21.15.60:0/2878200126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78102a70 0x7f2f78110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 >> 172.21.15.60:0/2878200126 conn(0x7f2f78079710 msgr2=0x7f2f78104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 shutdown_connections 2024-09-21T07:33:50.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.590+0000 7f2f7e380640 1 -- 172.21.15.60:0/2878200126 wait complete. 2024-09-21T07:33:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.795+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f3c501a9350 con 0x7f3c50108cf0 2024-09-21T07:33:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.796+0000 7f3c42ffd640 1 -- 172.21.15.60:0/1427249341 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3c480b2650 con 0x7f3c50108cf0 2024-09-21T07:33:50.798 INFO:teuthology.orchestra.run.smithi060.stdout:244813135905 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3c3c0b65a0 msgr2=0x7f3c3c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3c3c0b65a0 0x7f3c3c0b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3c44005ec0 tx=0x7f3c44005a20 comp rx=0 tx=0).stop 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 msgr2=0x7f3c50104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 0x7f3c50104cd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009fd0 tx=0x7f3c4800ef10 comp rx=0 tx=0).stop 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 shutdown_connections 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f3c3c0b65a0 0x7f3c3c0b8ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c50108cf0 0x7f3c50104cd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c501083a0 0x7f3c50104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 --2- 172.21.15.60:0/1427249341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c50102a60 0x7f3c50104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 >> 172.21.15.60:0/1427249341 conn(0x7f3c50079730 msgr2=0x7f3c50106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 shutdown_connections 2024-09-21T07:33:50.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:50.798+0000 7f3c58151640 1 -- 172.21.15.60:0/1427249341 wait complete. 2024-09-21T07:33:50.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 -- 172.21.15.60:0/2487132427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 msgr2=0x7f1bf8102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 --2- 172.21.15.60:0/2487132427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf8102ed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009900 tx=0x7f1bf002a410 comp rx=0 tx=0).stop 2024-09-21T07:33:50.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 -- 172.21.15.60:0/2487132427 shutdown_connections 2024-09-21T07:33:50.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 --2- 172.21.15.60:0/2487132427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf8108d00 0x7f1bf810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 --2- 172.21.15.60:0/2487132427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bf81083b0 0x7f1bf81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 --2- 172.21.15.60:0/2487132427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf8102ed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 -- 172.21.15.60:0/2487132427 >> 172.21.15.60:0/2487132427 conn(0x7f1bf8079790 msgr2=0x7f1bf8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 -- 172.21.15.60:0/2487132427 shutdown_connections 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.716+0000 7f1bfe693640 1 -- 172.21.15.60:0/2487132427 wait complete. 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 Processor -- start 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 -- start start 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf80ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf81083b0 0x7f1bf80ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bf8108d00 0x7f1bf81000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81129c0 con 0x7f1bf8102ac0 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8112840 con 0x7f1bf8108d00 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfe693640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8112b40 con 0x7f1bf81083b0 2024-09-21T07:33:50.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf80ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf80ff650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48566/0 (socket says 172.21.15.60:48566) 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 -- 172.21.15.60:0/620615770 learned_addr learned my addr 172.21.15.60:0/620615770 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bfcc30640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bf8108d00 0x7f1bf81000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf77fe640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf81083b0 0x7f1bf80ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 -- 172.21.15.60:0/620615770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf81083b0 msgr2=0x7f1bf80ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf81083b0 0x7f1bf80ffb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 -- 172.21.15.60:0/620615770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bf8108d00 msgr2=0x7f1bf81000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.717+0000 7f1bf7fff640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bf8108d00 0x7f1bf81000d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bf7fff640 1 -- 172.21.15.60:0/620615770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf81a8780 con 0x7f1bf8102ac0 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bf77fe640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf81083b0 0x7f1bf80ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bf7fff640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf80ff650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0005940 tx=0x7f1bf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf003f030 con 0x7f1bf8102ac0 2024-09-21T07:33:50.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bf0003cb0 con 0x7f1bf8102ac0 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf81a8a10 con 0x7f1bf8102ac0 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0035070 con 0x7f1bf8102ac0 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.718+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf81a8ef0 con 0x7f1bf8102ac0 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.719+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf8102ed0 con 0x7f1bf8102ac0 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.721+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1bf0042030 con 0x7f1bf8102ac0 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stdout:34359738446 2024-09-21T07:33:50.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.721+0000 7f1bf57fa640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1be40b65a0 0x7f1be40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.721+0000 7f1bf77fe640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1be40b65a0 0x7f1be40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.721+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f1bf0108080 con 0x7f1bf8102ac0 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.722+0000 7f1bf77fe640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1be40b65a0 0x7f1be40b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bf806c900 tx=0x7f1be80093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.725+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bf00ce7e0 con 0x7f1bf8102ac0 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.919+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1bf802e640 con 0x7f1bf8102ac0 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.919+0000 7f1bf57fa640 1 -- 172.21.15.60:0/620615770 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bf00d2bc0 con 0x7f1bf8102ac0 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.921+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1be40b65a0 msgr2=0x7f1be40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.921+0000 7f1bfe693640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1be40b65a0 0x7f1be40b8ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bf806c900 tx=0x7f1be80093e0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.921+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 msgr2=0x7f1bf80ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.921+0000 7f1bfe693640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf80ff650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0005940 tx=0x7f1bf00042f0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 shutdown_connections 2024-09-21T07:33:50.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f1be40b65a0 0x7f1be40b8ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bf8108d00 0x7f1bf81000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bf81083b0 0x7f1bf80ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 --2- 172.21.15.60:0/620615770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf8102ac0 0x7f1bf80ff650 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 >> 172.21.15.60:0/620615770 conn(0x7f1bf8079790 msgr2=0x7f1bf8101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 shutdown_connections 2024-09-21T07:33:50.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:49.922+0000 7f1bfe693640 1 -- 172.21.15.60:0/620615770 wait complete. 2024-09-21T07:33:50.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:50 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2878200126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:33:50.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:50.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:50.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:50.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:50 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:50.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:50 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1427249341' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:33:51.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:50 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2878200126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:33:51.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.092 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:50 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.092 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:50 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1427249341' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 -- 172.21.15.60:0/1168003695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6764105300 msgr2=0x7f676410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 --2- 172.21.15.60:0/1168003695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6764105300 0x7f676410d850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f674c009900 tx=0x7f674c02a410 comp rx=0 tx=0).stop 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 -- 172.21.15.60:0/1168003695 shutdown_connections 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 --2- 172.21.15.60:0/1168003695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f676410de10 0x7f6764110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 --2- 172.21.15.60:0/1168003695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6764105300 0x7f676410d850 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 --2- 172.21.15.60:0/1168003695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67641049b0 0x7f6764104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 -- 172.21.15.60:0/1168003695 >> 172.21.15.60:0/1168003695 conn(0x7f6764079730 msgr2=0x7f6764079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 -- 172.21.15.60:0/1168003695 shutdown_connections 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.089+0000 7f676a167640 1 -- 172.21.15.60:0/1168003695 wait complete. 2024-09-21T07:33:51.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 Processor -- start 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 -- start start 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67641049b0 0x7f676419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6764105300 0x7f676419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 0x7f676419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6764113a70 con 0x7f676410de10 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f67641138f0 con 0x7f67641049b0 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.090+0000 7f676a167640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6764113bf0 con 0x7f6764105300 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 0x7f676419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 0x7f676419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48604/0 (socket says 172.21.15.60:48604) 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f675affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6764105300 0x7f676419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 -- 172.21.15.60:0/1662697114 learned_addr learned my addr 172.21.15.60:0/1662697114 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:51.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f67637fe640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67641049b0 0x7f676419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 -- 172.21.15.60:0/1662697114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6764105300 msgr2=0x7f676419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6764105300 0x7f676419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 -- 172.21.15.60:0/1662697114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67641049b0 msgr2=0x7f676419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67641049b0 0x7f676419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 -- 172.21.15.60:0/1662697114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67641a03d0 con 0x7f676410de10 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f6763fff640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 0x7f676419fca0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f675c009fd0 tx=0x7f675c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c017070 con 0x7f676410de10 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67641a06c0 con 0x7f676410de10 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f675c003e20 con 0x7f676410de10 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c010460 con 0x7f676410de10 2024-09-21T07:33:51.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.091+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67641025d0 con 0x7f676410de10 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.093+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6764104dc0 con 0x7f676410de10 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.094+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f675c003970 con 0x7f676410de10 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.095+0000 7f67617fa640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f67500b65a0 0x7f67500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.095+0000 7f67637fe640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f67500b65a0 0x7f67500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.095+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f675c0e70c0 con 0x7f676410de10 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.095+0000 7f67637fe640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f67500b65a0 0x7f67500b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6754005fd0 tx=0x7f675400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:51.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.099+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f675c0b1c00 con 0x7f676410de10 2024-09-21T07:33:51.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.290+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6764108f10 con 0x7f676410de10 2024-09-21T07:33:51.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.290+0000 7f67617fa640 1 -- 172.21.15.60:0/1662697114 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f675c0b6b40 con 0x7f676410de10 2024-09-21T07:33:51.292 INFO:teuthology.orchestra.run.smithi060.stdout:128849018939 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f67500b65a0 msgr2=0x7f67500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f67500b65a0 0x7f67500b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6754005fd0 tx=0x7f675400b410 comp rx=0 tx=0).stop 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 msgr2=0x7f676419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 0x7f676419fca0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f675c009fd0 tx=0x7f675c00b260 comp rx=0 tx=0).stop 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 shutdown_connections 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f67500b65a0 0x7f67500b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f676410de10 0x7f676419fca0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6764105300 0x7f676419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 --2- 172.21.15.60:0/1662697114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67641049b0 0x7f676419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:51.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 >> 172.21.15.60:0/1662697114 conn(0x7f6764079730 msgr2=0x7f67641008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:51.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 shutdown_connections 2024-09-21T07:33:51.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:51.292+0000 7f676a167640 1 -- 172.21.15.60:0/1662697114 wait complete. 2024-09-21T07:33:51.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:50 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2878200126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:33:51.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:50 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:33:51.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:50 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1427249341' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:33:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 -- 172.21.15.60:0/878669707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 msgr2=0x7fe9d8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 --2- 172.21.15.60:0/878669707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d8110630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009900 tx=0x7fe9d002a410 comp rx=0 tx=0).stop 2024-09-21T07:33:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 -- 172.21.15.60:0/878669707 shutdown_connections 2024-09-21T07:33:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 --2- 172.21.15.60:0/878669707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d8110630 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 --2- 172.21.15.60:0/878669707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d81094b0 0x7fe9d81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 --2- 172.21.15.60:0/878669707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 0x7fe9d8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 -- 172.21.15.60:0/878669707 >> 172.21.15.60:0/878669707 conn(0x7fe9d8077c60 msgr2=0x7fe9d80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 -- 172.21.15.60:0/878669707 shutdown_connections 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.022+0000 7fe9df14c640 1 -- 172.21.15.60:0/878669707 wait complete. 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 Processor -- start 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 -- start start 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 0x7fe9d819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d81094b0 0x7fe9d819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8113b40 con 0x7fe9d8109e00 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d81139c0 con 0x7fe9d8101f70 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9df14c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8113cc0 con 0x7fe9d81094b0 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9dd6e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9dd6e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48628/0 (socket says 172.21.15.60:48628) 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9dd6e9640 1 -- 172.21.15.60:0/510846109 learned_addr learned my addr 172.21.15.60:0/510846109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9d7fff640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d81094b0 0x7fe9d819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.023+0000 7fe9dcee8640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 0x7fe9d819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dd6e9640 1 -- 172.21.15.60:0/510846109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d81094b0 msgr2=0x7fe9d819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dd6e9640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d81094b0 0x7fe9d819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dd6e9640 1 -- 172.21.15.60:0/510846109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 msgr2=0x7fe9d819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dd6e9640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 0x7fe9d819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dd6e9640 1 -- 172.21.15.60:0/510846109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d81a0420 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dcee8640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 0x7fe9d819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9dd6e9640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d819fcf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004770 tx=0x7fe9d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d003f030 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d0003aa0 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d81a06b0 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0035070 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.024+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d81a6e70 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.025+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d8102380 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.027+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe9d0042030 con 0x7fe9d8109e00 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.028+0000 7fe9d5ffb640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe9c40b65a0 0x7fe9c40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.028+0000 7fe9dcee8640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe9c40b65a0 0x7fe9c40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.028+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fe9d0107eb0 con 0x7fe9d8109e00 2024-09-21T07:33:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.029+0000 7fe9dcee8640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe9c40b65a0 0x7fe9c40b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009930 tx=0x7fe9c8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.032+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9d00ce610 con 0x7fe9d8109e00 2024-09-21T07:33:52.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:51 smithi060 ceph-mon[31244]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:33:52.134 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:51 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1662697114' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:33:52.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822711 for osd.5 2024-09-21T07:33:52.162 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:52.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.223+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe9d810bbd0 con 0x7fe9d8109e00 2024-09-21T07:33:52.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.223+0000 7fe9d5ffb640 1 -- 172.21.15.60:0/510846109 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9d00d29f0 con 0x7fe9d8109e00 2024-09-21T07:33:52.225 INFO:teuthology.orchestra.run.smithi060.stdout:73014444102 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe9c40b65a0 msgr2=0x7fe9c40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe9c40b65a0 0x7fe9c40b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009930 tx=0x7fe9c8008040 comp rx=0 tx=0).stop 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 msgr2=0x7fe9d819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d819fcf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004770 tx=0x7fe9d0004270 comp rx=0 tx=0).stop 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 shutdown_connections 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe9c40b65a0 0x7fe9c40b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9d8109e00 0x7fe9d819fcf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9d81094b0 0x7fe9d819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 --2- 172.21.15.60:0/510846109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9d8101f70 0x7fe9d819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 >> 172.21.15.60:0/510846109 conn(0x7fe9d8077c60 msgr2=0x7fe9d81074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 shutdown_connections 2024-09-21T07:33:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:52.226+0000 7fe9df14c640 1 -- 172.21.15.60:0/510846109 wait complete. 2024-09-21T07:33:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:51 smithi187 ceph-mon[34367]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:33:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:51 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1662697114' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:33:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:51 smithi123 ceph-mon[34166]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:33:52.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:51 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1662697114' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:33:53.026 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444099 got 73014444102 for osd.2 2024-09-21T07:33:53.026 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:53.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:52 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/510846109' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:33:53.294 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:52 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/510846109' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:33:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 -- 172.21.15.60:0/4008403007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 msgr2=0x7f62601087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 --2- 172.21.15.60:0/4008403007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f62601087c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6254009900 tx=0x7f625402a410 comp rx=0 tx=0).stop 2024-09-21T07:33:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 -- 172.21.15.60:0/4008403007 shutdown_connections 2024-09-21T07:33:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 --2- 172.21.15.60:0/4008403007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6260108d00 0x7f626010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 --2- 172.21.15.60:0/4008403007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f62601087c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 --2- 172.21.15.60:0/4008403007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6260102a70 0x7f6260102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 -- 172.21.15.60:0/4008403007 >> 172.21.15.60:0/4008403007 conn(0x7f6260079710 msgr2=0x7f6260079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 -- 172.21.15.60:0/4008403007 shutdown_connections 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.292+0000 7f6266930640 1 -- 172.21.15.60:0/4008403007 wait complete. 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 Processor -- start 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 -- start start 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6260102a70 0x7f626019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f626019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6260108d00 0x7f626019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113ac0 con 0x7f62601083b0 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113940 con 0x7f6260108d00 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f6266930640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f6260113c40 con 0x7f6260102a70 2024-09-21T07:33:53.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f626019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f626019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48636/0 (socket says 172.21.15.60:48636) 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.293+0000 7f625f7fe640 1 -- 172.21.15.60:0/76711996 learned_addr learned my addr 172.21.15.60:0/76711996 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625ffff640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6260102a70 0x7f626019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f6264ecd640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6260108d00 0x7f626019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625f7fe640 1 -- 172.21.15.60:0/76711996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6260102a70 msgr2=0x7f626019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625f7fe640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6260102a70 0x7f626019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625f7fe640 1 -- 172.21.15.60:0/76711996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6260108d00 msgr2=0x7f626019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625f7fe640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6260108d00 0x7f626019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625f7fe640 1 -- 172.21.15.60:0/76711996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62601a0460 con 0x7f62601083b0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625f7fe640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f626019ab50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6254006010 tx=0x7f6254004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625403f030 con 0x7f62601083b0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601a06f0 con 0x7f62601083b0 2024-09-21T07:33:53.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6254003aa0 con 0x7f62601083b0 2024-09-21T07:33:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254035070 con 0x7f62601083b0 2024-09-21T07:33:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.294+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601a0bd0 con 0x7f62601083b0 2024-09-21T07:33:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.295+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6260103cf0 con 0x7f62601083b0 2024-09-21T07:33:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.297+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6254042030 con 0x7f62601083b0 2024-09-21T07:33:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.298+0000 7f625d7fa640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f62480b65d0 0x7f62480b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.298+0000 7f625ffff640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f62480b65d0 0x7f62480b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.298+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f6254107ca0 con 0x7f62601083b0 2024-09-21T07:33:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.299+0000 7f625ffff640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f62480b65d0 0x7f62480b8ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6250009bd0 tx=0x7f6250005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:53.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.302+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62540d27e0 con 0x7f62601083b0 2024-09-21T07:33:53.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:52 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/510846109' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:33:53.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.491+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6260102e80 con 0x7f62601083b0 2024-09-21T07:33:53.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.491+0000 7f625d7fa640 1 -- 172.21.15.60:0/76711996 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6260102e80 con 0x7f62601083b0 2024-09-21T07:33:53.493 INFO:teuthology.orchestra.run.smithi060.stdout:197568495661 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f62480b65d0 msgr2=0x7f62480b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f62480b65d0 0x7f62480b8ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6250009bd0 tx=0x7f6250005f90 comp rx=0 tx=0).stop 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 msgr2=0x7f626019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f626019ab50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6254006010 tx=0x7f6254004060 comp rx=0 tx=0).stop 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 shutdown_connections 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f62480b65d0 0x7f62480b8ae0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6260108d00 0x7f626019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62601083b0 0x7f626019ab50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 --2- 172.21.15.60:0/76711996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6260102a70 0x7f626019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 >> 172.21.15.60:0/76711996 conn(0x7f6260079710 msgr2=0x7f6260104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 shutdown_connections 2024-09-21T07:33:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:53.494+0000 7f6266930640 1 -- 172.21.15.60:0/76711996 wait complete. 2024-09-21T07:33:53.541 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:54.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:53 smithi060 ceph-mon[31244]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T07:33:54.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:53 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/76711996' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:33:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:53 smithi187 ceph-mon[34367]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T07:33:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:53 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/76711996' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:33:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:53 smithi123 ceph-mon[34166]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T07:33:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:53 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/76711996' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:33:54.396 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018937 got 128849018939 for osd.4 2024-09-21T07:33:54.396 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:54.784 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972378 got 266287972381 for osd.10 2024-09-21T07:33:54.784 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:55.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135904 got 244813135905 for osd.9 2024-09-21T07:33:55.318 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:55.695 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-21T07:33:55.695 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:55 smithi187 ceph-mon[34367]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:33:56.273 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:55 smithi060 ceph-mon[31244]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:33:56.305 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495658 got 197568495661 for osd.7 2024-09-21T07:33:56.305 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:55 smithi123 ceph-mon[34166]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:33:56.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 -- 172.21.15.60:0/2052411285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488109df0 msgr2=0x7f0488110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 --2- 172.21.15.60:0/2052411285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488109df0 0x7f0488110620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0480009ca0 tx=0x7f048002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 -- 172.21.15.60:0/2052411285 shutdown_connections 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 --2- 172.21.15.60:0/2052411285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488109df0 0x7f0488110620 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 --2- 172.21.15.60:0/2052411285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04881094a0 0x7f04881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 --2- 172.21.15.60:0/2052411285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488103b60 0x7f0488103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 -- 172.21.15.60:0/2052411285 >> 172.21.15.60:0/2052411285 conn(0x7f048807b850 msgr2=0x7f048807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 -- 172.21.15.60:0/2052411285 shutdown_connections 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.464+0000 7f048f19a640 1 -- 172.21.15.60:0/2052411285 wait complete. 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 Processor -- start 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 -- start start 2024-09-21T07:33:56.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 0x7f048819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04881094a0 0x7f048819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488109df0 0x7f048819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0488113b00 con 0x7f0488103b60 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0488113980 con 0x7f0488109df0 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048f19a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0488113c80 con 0x7f04881094a0 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048cf36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 0x7f048819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048cf36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 0x7f048819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48662/0 (socket says 172.21.15.60:48662) 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f048cf36640 1 -- 172.21.15.60:0/32937965 learned_addr learned my addr 172.21.15.60:0/32937965 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.465+0000 7f0487fff640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04881094a0 0x7f048819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048cf36640 1 -- 172.21.15.60:0/32937965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04881094a0 msgr2=0x7f048819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048cf36640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04881094a0 0x7f048819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048cf36640 1 -- 172.21.15.60:0/32937965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488109df0 msgr2=0x7f048819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048d737640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488109df0 0x7f048819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048cf36640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488109df0 0x7f048819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048cf36640 1 -- 172.21.15.60:0/32937965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04881a03a0 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048d737640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488109df0 0x7f048819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048cf36640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 0x7f048819a430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f047800d950 tx=0x7f047800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478017070 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04881a0690 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0478009c30 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047800f620 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.466+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04881a6df0 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.467+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0488103f70 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.469+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0478005030 con 0x7f0488103b60 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.470+0000 7f0485ffb640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04700b65a0 0x7f04700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:56.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.470+0000 7f0487fff640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04700b65a0 0x7f04700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:56.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.470+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f04780e7110 con 0x7f0488103b60 2024-09-21T07:33:56.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.471+0000 7f0487fff640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04700b65a0 0x7f04700b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f047c005fd0 tx=0x7f047c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:56.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.474+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04780ad870 con 0x7f0488103b60 2024-09-21T07:33:56.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.670+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f048802e640 con 0x7f0488103b60 2024-09-21T07:33:56.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.671+0000 7f0485ffb640 1 -- 172.21.15.60:0/32937965 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0478009de0 con 0x7f0488103b60 2024-09-21T07:33:56.673 INFO:teuthology.orchestra.run.smithi060.stdout:176093659186 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04700b65a0 msgr2=0x7f04700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04700b65a0 0x7f04700b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f047c005fd0 tx=0x7f047c005850 comp rx=0 tx=0).stop 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 msgr2=0x7f048819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 0x7f048819a430 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f047800d950 tx=0x7f047800de10 comp rx=0 tx=0).stop 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 shutdown_connections 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04700b65a0 0x7f04700b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0488109df0 0x7f048819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04881094a0 0x7f048819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 --2- 172.21.15.60:0/32937965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0488103b60 0x7f048819a430 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:56.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 >> 172.21.15.60:0/32937965 conn(0x7f048807b850 msgr2=0x7f0488105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:56.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 shutdown_connections 2024-09-21T07:33:56.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:56.673+0000 7f048f19a640 1 -- 172.21.15.60:0/32937965 wait complete. 2024-09-21T07:33:57.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:56 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/32937965' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:33:57.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:56 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/32937965' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:33:57.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:56 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/32937965' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:33:57.482 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659183 got 176093659186 for osd.6 2024-09-21T07:33:57.482 DEBUG:teuthology.parallel:result is None 2024-09-21T07:33:57.482 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:33:57.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:33:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:33:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:57 smithi187 ceph-mon[34367]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:33:58.321 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:57 smithi060 ceph-mon[31244]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:33:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:57 smithi123 ceph-mon[34166]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:33:58.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.414+0000 7f74daac8640 1 -- 172.21.15.60:0/601769776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 msgr2=0x7f74d410ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.414+0000 7f74daac8640 1 --2- 172.21.15.60:0/601769776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d410ed60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00adb0 tx=0x7f74cc02b7a0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 -- 172.21.15.60:0/601769776 shutdown_connections 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 --2- 172.21.15.60:0/601769776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d410ed60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 --2- 172.21.15.60:0/601769776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d4107be0 0x7f74d4107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 --2- 172.21.15.60:0/601769776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74d41022a0 0x7f74d41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 -- 172.21.15.60:0/601769776 >> 172.21.15.60:0/601769776 conn(0x7f74d4079ec0 msgr2=0x7f74d407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 -- 172.21.15.60:0/601769776 shutdown_connections 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.415+0000 7f74daac8640 1 -- 172.21.15.60:0/601769776 wait complete. 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 Processor -- start 2024-09-21T07:33:58.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 -- start start 2024-09-21T07:33:58.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d41022a0 0x7f74d4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74d4107be0 0x7f74d41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74d9065640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74d9065640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39162/0 (socket says 172.21.15.60:39162) 2024-09-21T07:33:58.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74d9065640 1 -- 172.21.15.60:0/3658638619 learned_addr learned my addr 172.21.15.60:0/3658638619 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4111970 con 0x7f74d4108530 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41117f0 con 0x7f74d41022a0 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4111af0 con 0x7f74d4107be0 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.416+0000 7f74d8864640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d41022a0 0x7f74d4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d3fff640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74d4107be0 0x7f74d41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d8864640 1 -- 172.21.15.60:0/3658638619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74d4107be0 msgr2=0x7f74d41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d8864640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74d4107be0 0x7f74d41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d8864640 1 -- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 msgr2=0x7f74d419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d8864640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d8864640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d419e1d0 con 0x7f74d41022a0 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d9065640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:33:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.417+0000 7f74d8864640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d41022a0 0x7f74d4198320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c970 tx=0x7f74c800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.418+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c8007bb0 con 0x7f74d41022a0 2024-09-21T07:33:58.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.418+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d419e4c0 con 0x7f74d41022a0 2024-09-21T07:33:58.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.418+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c8007d50 con 0x7f74d41022a0 2024-09-21T07:33:58.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.418+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c8007bb0 con 0x7f74d41022a0 2024-09-21T07:33:58.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.418+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d41a4ce0 con 0x7f74d41022a0 2024-09-21T07:33:58.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.419+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d41026b0 con 0x7f74d41022a0 2024-09-21T07:33:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.422+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f74c800f450 con 0x7f74d41022a0 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.422+0000 7f74d1ffb640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f74c40b6850 0x7f74c40b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.422+0000 7f74d3fff640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f74c40b6850 0x7f74c40b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:33:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.422+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f74c80e6fe0 con 0x7f74d41022a0 2024-09-21T07:33:58.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.423+0000 7f74d3fff640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f74c40b6850 0x7f74c40b8d60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f74d41077b0 tx=0x7f74c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:33:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.425+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74c801d060 con 0x7f74d41022a0 2024-09-21T07:33:58.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.635+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74d4063800 con 0x7f74c40b6850 2024-09-21T07:33:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.640+0000 7f74d1ffb640 1 -- 172.21.15.60:0/3658638619 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258712 (secure 0 0 0) 0x7f74d4063800 con 0x7f74c40b6850 2024-09-21T07:33:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:33:58.645 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-21T07:33:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f74c40b6850 msgr2=0x7f74c40b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f74c40b6850 0x7f74c40b8d60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f74d41077b0 tx=0x7f74c000b390 comp rx=0 tx=0).stop 2024-09-21T07:33:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d41022a0 msgr2=0x7f74d4198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:33:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d41022a0 0x7f74d4198320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c970 tx=0x7f74c800ce30 comp rx=0 tx=0).stop 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 shutdown_connections 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f74c40b6850 0x7f74c40b8d60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74d4108530 0x7f74d419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74d4107be0 0x7f74d41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 --2- 172.21.15.60:0/3658638619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74d41022a0 0x7f74d4198320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.644+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 >> 172.21.15.60:0/3658638619 conn(0x7f74d4079ec0 msgr2=0x7f74d4105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.645+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 shutdown_connections 2024-09-21T07:33:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:33:58.645+0000 7f74daac8640 1 -- 172.21.15.60:0/3658638619 wait complete. 2024-09-21T07:33:59.338 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-21T07:33:58.618933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658505,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":417,"num_read_kb":305,"num_write":285,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":3016498,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394352,"kb_used_data":11736,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547472,"statfs":{"total":1151940427776,"available":1151536611328,"internally_reserved":0,"allocated":12017664,"data_stored":6773595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19154,"internal_metadata":391492910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003377"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931621+0000","last_change":"2024-09-21T07:32:53.330750+0000","last_active":"2024-09-21T07:33:33.931621+0000","last_peered":"2024-09-21T07:33:33.931621+0000","last_clean":"2024-09-21T07:33:33.931621+0000","last_became_active":"2024-09-21T07:32:53.330371+0000","last_became_peered":"2024-09-21T07:32:53.330371+0000","last_unstale":"2024-09-21T07:33:33.931621+0000","last_undegraded":"2024-09-21T07:33:33.931621+0000","last_fullsized":"2024-09-21T07:33:33.931621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:53.413349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934385+0000","last_change":"2024-09-21T07:32:53.329867+0000","last_active":"2024-09-21T07:33:33.934385+0000","last_peered":"2024-09-21T07:33:33.934385+0000","last_clean":"2024-09-21T07:33:33.934385+0000","last_became_active":"2024-09-21T07:32:53.329126+0000","last_became_peered":"2024-09-21T07:32:53.329126+0000","last_unstale":"2024-09-21T07:33:33.934385+0000","last_undegraded":"2024-09-21T07:33:33.934385+0000","last_fullsized":"2024-09-21T07:33:33.934385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:42.184172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934310+0000","last_change":"2024-09-21T07:32:53.332835+0000","last_active":"2024-09-21T07:33:33.934310+0000","last_peered":"2024-09-21T07:33:33.934310+0000","last_clean":"2024-09-21T07:33:33.934310+0000","last_became_active":"2024-09-21T07:32:53.332453+0000","last_became_peered":"2024-09-21T07:32:53.332453+0000","last_unstale":"2024-09-21T07:33:33.934310+0000","last_undegraded":"2024-09-21T07:33:33.934310+0000","last_fullsized":"2024-09-21T07:33:33.934310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:09.376263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929381+0000","last_change":"2024-09-21T07:32:53.332373+0000","last_active":"2024-09-21T07:33:33.929381+0000","last_peered":"2024-09-21T07:33:33.929381+0000","last_clean":"2024-09-21T07:33:33.929381+0000","last_became_active":"2024-09-21T07:32:53.331879+0000","last_became_peered":"2024-09-21T07:32:53.331879+0000","last_unstale":"2024-09-21T07:33:33.929381+0000","last_undegraded":"2024-09-21T07:33:33.929381+0000","last_fullsized":"2024-09-21T07:33:33.929381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:23.843203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929436+0000","last_change":"2024-09-21T07:32:53.327490+0000","last_active":"2024-09-21T07:33:33.929436+0000","last_peered":"2024-09-21T07:33:33.929436+0000","last_clean":"2024-09-21T07:33:33.929436+0000","last_became_active":"2024-09-21T07:32:53.327040+0000","last_became_peered":"2024-09-21T07:32:53.327040+0000","last_unstale":"2024-09-21T07:33:33.929436+0000","last_undegraded":"2024-09-21T07:33:33.929436+0000","last_fullsized":"2024-09-21T07:33:33.929436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.621877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932753+0000","last_change":"2024-09-21T07:32:53.338026+0000","last_active":"2024-09-21T07:33:33.932753+0000","last_peered":"2024-09-21T07:33:33.932753+0000","last_clean":"2024-09-21T07:33:33.932753+0000","last_became_active":"2024-09-21T07:32:53.337091+0000","last_became_peered":"2024-09-21T07:32:53.337091+0000","last_unstale":"2024-09-21T07:33:33.932753+0000","last_undegraded":"2024-09-21T07:33:33.932753+0000","last_fullsized":"2024-09-21T07:33:33.932753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.363161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930962+0000","last_change":"2024-09-21T07:32:53.333109+0000","last_active":"2024-09-21T07:33:33.930962+0000","last_peered":"2024-09-21T07:33:33.930962+0000","last_clean":"2024-09-21T07:33:33.930962+0000","last_became_active":"2024-09-21T07:32:53.332726+0000","last_became_peered":"2024-09-21T07:32:53.332726+0000","last_unstale":"2024-09-21T07:33:33.930962+0000","last_undegraded":"2024-09-21T07:33:33.930962+0000","last_fullsized":"2024-09-21T07:33:33.930962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:06.553522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937745+0000","last_change":"2024-09-21T07:33:33.937243+0000","last_active":"2024-09-21T07:33:33.937745+0000","last_peered":"2024-09-21T07:33:33.937745+0000","last_clean":"2024-09-21T07:33:33.937745+0000","last_became_active":"2024-09-21T07:33:33.936782+0000","last_became_peered":"2024-09-21T07:33:33.936782+0000","last_unstale":"2024-09-21T07:33:33.937745+0000","last_undegraded":"2024-09-21T07:33:33.937745+0000","last_fullsized":"2024-09-21T07:33:33.937745+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:25.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937857+0000","last_change":"2024-09-21T07:32:53.333433+0000","last_active":"2024-09-21T07:33:33.937857+0000","last_peered":"2024-09-21T07:33:33.937857+0000","last_clean":"2024-09-21T07:33:33.937857+0000","last_became_active":"2024-09-21T07:32:53.332975+0000","last_became_peered":"2024-09-21T07:32:53.332975+0000","last_unstale":"2024-09-21T07:33:33.937857+0000","last_undegraded":"2024-09-21T07:33:33.937857+0000","last_fullsized":"2024-09-21T07:33:33.937857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:35.820439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.933322+0000","last_change":"2024-09-21T07:32:53.337488+0000","last_active":"2024-09-21T07:33:33.933322+0000","last_peered":"2024-09-21T07:33:33.933322+0000","last_clean":"2024-09-21T07:33:33.933322+0000","last_became_active":"2024-09-21T07:32:53.337104+0000","last_became_peered":"2024-09-21T07:32:53.337104+0000","last_unstale":"2024-09-21T07:33:33.933322+0000","last_undegraded":"2024-09-21T07:33:33.933322+0000","last_fullsized":"2024-09-21T07:33:33.933322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:53.862578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931168+0000","last_change":"2024-09-21T07:32:53.332543+0000","last_active":"2024-09-21T07:33:33.931168+0000","last_peered":"2024-09-21T07:33:33.931168+0000","last_clean":"2024-09-21T07:33:33.931168+0000","last_became_active":"2024-09-21T07:32:53.332174+0000","last_became_peered":"2024-09-21T07:32:53.332174+0000","last_unstale":"2024-09-21T07:33:33.931168+0000","last_undegraded":"2024-09-21T07:33:33.931168+0000","last_fullsized":"2024-09-21T07:33:33.931168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:07.268377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929424+0000","last_change":"2024-09-21T07:32:53.334231+0000","last_active":"2024-09-21T07:33:33.929424+0000","last_peered":"2024-09-21T07:33:33.929424+0000","last_clean":"2024-09-21T07:33:33.929424+0000","last_became_active":"2024-09-21T07:32:53.333838+0000","last_became_peered":"2024-09-21T07:32:53.333838+0000","last_unstale":"2024-09-21T07:33:33.929424+0000","last_undegraded":"2024-09-21T07:33:33.929424+0000","last_fullsized":"2024-09-21T07:33:33.929424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:21.772942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962863+0000","last_change":"2024-09-21T07:32:53.328673+0000","last_active":"2024-09-21T07:33:33.962863+0000","last_peered":"2024-09-21T07:33:33.962863+0000","last_clean":"2024-09-21T07:33:33.962863+0000","last_became_active":"2024-09-21T07:32:53.328355+0000","last_became_peered":"2024-09-21T07:32:53.328355+0000","last_unstale":"2024-09-21T07:33:33.962863+0000","last_undegraded":"2024-09-21T07:33:33.962863+0000","last_fullsized":"2024-09-21T07:33:33.962863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:35.337114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934362+0000","last_change":"2024-09-21T07:32:53.332000+0000","last_active":"2024-09-21T07:33:33.934362+0000","last_peered":"2024-09-21T07:33:33.934362+0000","last_clean":"2024-09-21T07:33:33.934362+0000","last_became_active":"2024-09-21T07:32:53.331304+0000","last_became_peered":"2024-09-21T07:32:53.331304+0000","last_unstale":"2024-09-21T07:33:33.934362+0000","last_undegraded":"2024-09-21T07:33:33.934362+0000","last_fullsized":"2024-09-21T07:33:33.934362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:22.911531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934105+0000","last_change":"2024-09-21T07:32:53.334403+0000","last_active":"2024-09-21T07:33:33.934105+0000","last_peered":"2024-09-21T07:33:33.934105+0000","last_clean":"2024-09-21T07:33:33.934105+0000","last_became_active":"2024-09-21T07:32:53.333927+0000","last_became_peered":"2024-09-21T07:32:53.333927+0000","last_unstale":"2024-09-21T07:33:33.934105+0000","last_undegraded":"2024-09-21T07:33:33.934105+0000","last_fullsized":"2024-09-21T07:33:33.934105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:12.312055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935704+0000","last_change":"2024-09-21T07:32:53.335374+0000","last_active":"2024-09-21T07:33:33.935704+0000","last_peered":"2024-09-21T07:33:33.935704+0000","last_clean":"2024-09-21T07:33:33.935704+0000","last_became_active":"2024-09-21T07:32:53.334880+0000","last_became_peered":"2024-09-21T07:32:53.334880+0000","last_unstale":"2024-09-21T07:33:33.935704+0000","last_undegraded":"2024-09-21T07:33:33.935704+0000","last_fullsized":"2024-09-21T07:33:33.935704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:37.743094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931685+0000","last_change":"2024-09-21T07:32:53.333244+0000","last_active":"2024-09-21T07:33:33.931685+0000","last_peered":"2024-09-21T07:33:33.931685+0000","last_clean":"2024-09-21T07:33:33.931685+0000","last_became_active":"2024-09-21T07:32:53.332067+0000","last_became_peered":"2024-09-21T07:32:53.332067+0000","last_unstale":"2024-09-21T07:33:33.931685+0000","last_undegraded":"2024-09-21T07:33:33.931685+0000","last_fullsized":"2024-09-21T07:33:33.931685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929840+0000","last_change":"2024-09-21T07:32:53.329304+0000","last_active":"2024-09-21T07:33:33.929840+0000","last_peered":"2024-09-21T07:33:33.929840+0000","last_clean":"2024-09-21T07:33:33.929840+0000","last_became_active":"2024-09-21T07:32:53.328921+0000","last_became_peered":"2024-09-21T07:32:53.328921+0000","last_unstale":"2024-09-21T07:33:33.929840+0000","last_undegraded":"2024-09-21T07:33:33.929840+0000","last_fullsized":"2024-09-21T07:33:33.929840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:16.099387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936994+0000","last_change":"2024-09-21T07:32:53.324658+0000","last_active":"2024-09-21T07:33:33.936994+0000","last_peered":"2024-09-21T07:33:33.936994+0000","last_clean":"2024-09-21T07:33:33.936994+0000","last_became_active":"2024-09-21T07:32:53.323584+0000","last_became_peered":"2024-09-21T07:32:53.323584+0000","last_unstale":"2024-09-21T07:33:33.936994+0000","last_undegraded":"2024-09-21T07:33:33.936994+0000","last_fullsized":"2024-09-21T07:33:33.936994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:10.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934689+0000","last_change":"2024-09-21T07:33:33.934582+0000","last_active":"2024-09-21T07:33:33.934689+0000","last_peered":"2024-09-21T07:33:33.934689+0000","last_clean":"2024-09-21T07:33:33.934689+0000","last_became_active":"2024-09-21T07:33:33.934167+0000","last_became_peered":"2024-09-21T07:33:33.934167+0000","last_unstale":"2024-09-21T07:33:33.934689+0000","last_undegraded":"2024-09-21T07:33:33.934689+0000","last_fullsized":"2024-09-21T07:33:33.934689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:18.926204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962905+0000","last_change":"2024-09-21T07:32:53.321185+0000","last_active":"2024-09-21T07:33:33.962905+0000","last_peered":"2024-09-21T07:33:33.962905+0000","last_clean":"2024-09-21T07:33:33.962905+0000","last_became_active":"2024-09-21T07:32:53.320799+0000","last_became_peered":"2024-09-21T07:32:53.320799+0000","last_unstale":"2024-09-21T07:33:33.962905+0000","last_undegraded":"2024-09-21T07:33:33.962905+0000","last_fullsized":"2024-09-21T07:33:33.962905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:45.289546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936340+0000","last_change":"2024-09-21T07:32:53.336314+0000","last_active":"2024-09-21T07:33:33.936340+0000","last_peered":"2024-09-21T07:33:33.936340+0000","last_clean":"2024-09-21T07:33:33.936340+0000","last_became_active":"2024-09-21T07:32:53.335817+0000","last_became_peered":"2024-09-21T07:32:53.335817+0000","last_unstale":"2024-09-21T07:33:33.936340+0000","last_undegraded":"2024-09-21T07:33:33.936340+0000","last_fullsized":"2024-09-21T07:33:33.936340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:02.707523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.927942+0000","last_change":"2024-09-21T07:32:53.326396+0000","last_active":"2024-09-21T07:33:33.927942+0000","last_peered":"2024-09-21T07:33:33.927942+0000","last_clean":"2024-09-21T07:33:33.927942+0000","last_became_active":"2024-09-21T07:32:53.325243+0000","last_became_peered":"2024-09-21T07:32:53.325243+0000","last_unstale":"2024-09-21T07:33:33.927942+0000","last_undegraded":"2024-09-21T07:33:33.927942+0000","last_fullsized":"2024-09-21T07:33:33.927942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:42.208673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935186+0000","last_change":"2024-09-21T07:32:53.339639+0000","last_active":"2024-09-21T07:33:33.935186+0000","last_peered":"2024-09-21T07:33:33.935186+0000","last_clean":"2024-09-21T07:33:33.935186+0000","last_became_active":"2024-09-21T07:32:53.337665+0000","last_became_peered":"2024-09-21T07:32:53.337665+0000","last_unstale":"2024-09-21T07:33:33.935186+0000","last_undegraded":"2024-09-21T07:33:33.935186+0000","last_fullsized":"2024-09-21T07:33:33.935186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:58.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928391+0000","last_change":"2024-09-21T07:32:53.334640+0000","last_active":"2024-09-21T07:33:33.928391+0000","last_peered":"2024-09-21T07:33:33.928391+0000","last_clean":"2024-09-21T07:33:33.928391+0000","last_became_active":"2024-09-21T07:32:53.333887+0000","last_became_peered":"2024-09-21T07:32:53.333887+0000","last_unstale":"2024-09-21T07:33:33.928391+0000","last_undegraded":"2024-09-21T07:33:33.928391+0000","last_fullsized":"2024-09-21T07:33:33.928391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:33.577056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937263+0000","last_change":"2024-09-21T07:32:53.329008+0000","last_active":"2024-09-21T07:33:33.937263+0000","last_peered":"2024-09-21T07:33:33.937263+0000","last_clean":"2024-09-21T07:33:33.937263+0000","last_became_active":"2024-09-21T07:32:53.328583+0000","last_became_peered":"2024-09-21T07:32:53.328583+0000","last_unstale":"2024-09-21T07:33:33.937263+0000","last_undegraded":"2024-09-21T07:33:33.937263+0000","last_fullsized":"2024-09-21T07:33:33.937263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:19.879625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932709+0000","last_change":"2024-09-21T07:32:53.330897+0000","last_active":"2024-09-21T07:33:33.932709+0000","last_peered":"2024-09-21T07:33:33.932709+0000","last_clean":"2024-09-21T07:33:33.932709+0000","last_became_active":"2024-09-21T07:32:53.330472+0000","last_became_peered":"2024-09-21T07:32:53.330472+0000","last_unstale":"2024-09-21T07:33:33.932709+0000","last_undegraded":"2024-09-21T07:33:33.932709+0000","last_fullsized":"2024-09-21T07:33:33.932709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:03.845202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962754+0000","last_change":"2024-09-21T07:32:53.331457+0000","last_active":"2024-09-21T07:33:33.962754+0000","last_peered":"2024-09-21T07:33:33.962754+0000","last_clean":"2024-09-21T07:33:33.962754+0000","last_became_active":"2024-09-21T07:32:53.330551+0000","last_became_peered":"2024-09-21T07:32:53.330551+0000","last_unstale":"2024-09-21T07:33:33.962754+0000","last_undegraded":"2024-09-21T07:33:33.962754+0000","last_fullsized":"2024-09-21T07:33:33.962754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:36.419521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934524+0000","last_change":"2024-09-21T07:32:53.334139+0000","last_active":"2024-09-21T07:33:33.934524+0000","last_peered":"2024-09-21T07:33:33.934524+0000","last_clean":"2024-09-21T07:33:33.934524+0000","last_became_active":"2024-09-21T07:32:53.333778+0000","last_became_peered":"2024-09-21T07:32:53.333778+0000","last_unstale":"2024-09-21T07:33:33.934524+0000","last_undegraded":"2024-09-21T07:33:33.934524+0000","last_fullsized":"2024-09-21T07:33:33.934524+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:23.964718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936382+0000","last_change":"2024-09-21T07:32:53.328320+0000","last_active":"2024-09-21T07:33:33.936382+0000","last_peered":"2024-09-21T07:33:33.936382+0000","last_clean":"2024-09-21T07:33:33.936382+0000","last_became_active":"2024-09-21T07:32:53.327262+0000","last_became_peered":"2024-09-21T07:32:53.327262+0000","last_unstale":"2024-09-21T07:33:33.936382+0000","last_undegraded":"2024-09-21T07:33:33.936382+0000","last_fullsized":"2024-09-21T07:33:33.936382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:43.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936207+0000","last_change":"2024-09-21T07:32:53.333008+0000","last_active":"2024-09-21T07:33:33.936207+0000","last_peered":"2024-09-21T07:33:33.936207+0000","last_clean":"2024-09-21T07:33:33.936207+0000","last_became_active":"2024-09-21T07:32:53.332647+0000","last_became_peered":"2024-09-21T07:32:53.332647+0000","last_unstale":"2024-09-21T07:33:33.936207+0000","last_undegraded":"2024-09-21T07:33:33.936207+0000","last_fullsized":"2024-09-21T07:33:33.936207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:29.678179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932394+0000","last_change":"2024-09-21T07:32:53.337814+0000","last_active":"2024-09-21T07:33:33.932394+0000","last_peered":"2024-09-21T07:33:33.932394+0000","last_clean":"2024-09-21T07:33:33.932394+0000","last_became_active":"2024-09-21T07:32:53.337401+0000","last_became_peered":"2024-09-21T07:32:53.337401+0000","last_unstale":"2024-09-21T07:33:33.932394+0000","last_undegraded":"2024-09-21T07:33:33.932394+0000","last_fullsized":"2024-09-21T07:33:33.932394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:33.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929443+0000","last_change":"2024-09-21T07:32:53.329954+0000","last_active":"2024-09-21T07:33:33.929443+0000","last_peered":"2024-09-21T07:33:33.929443+0000","last_clean":"2024-09-21T07:33:33.929443+0000","last_became_active":"2024-09-21T07:32:53.329593+0000","last_became_peered":"2024-09-21T07:32:53.329593+0000","last_unstale":"2024-09-21T07:33:33.929443+0000","last_undegraded":"2024-09-21T07:33:33.929443+0000","last_fullsized":"2024-09-21T07:33:33.929443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:12.032893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:56.973767+0000","last_change":"2024-09-21T07:33:33.942649+0000","last_active":"2024-09-21T07:33:56.973767+0000","last_peered":"2024-09-21T07:33:56.973767+0000","last_clean":"2024-09-21T07:33:56.973767+0000","last_became_active":"2024-09-21T07:33:33.937331+0000","last_became_peered":"2024-09-21T07:33:33.937331+0000","last_unstale":"2024-09-21T07:33:56.973767+0000","last_undegraded":"2024-09-21T07:33:56.973767+0000","last_fullsized":"2024-09-21T07:33:56.973767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:29.609077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934858+0000","last_change":"2024-09-21T07:32:53.340005+0000","last_active":"2024-09-21T07:33:33.934858+0000","last_peered":"2024-09-21T07:33:33.934858+0000","last_clean":"2024-09-21T07:33:33.934858+0000","last_became_active":"2024-09-21T07:32:53.339433+0000","last_became_peered":"2024-09-21T07:32:53.339433+0000","last_unstale":"2024-09-21T07:33:33.934858+0000","last_undegraded":"2024-09-21T07:33:33.934858+0000","last_fullsized":"2024-09-21T07:33:33.934858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:16.469652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932830+0000","last_change":"2024-09-21T07:32:51.320218+0000","last_active":"2024-09-21T07:33:33.932830+0000","last_peered":"2024-09-21T07:33:33.932830+0000","last_clean":"2024-09-21T07:33:33.932830+0000","last_became_active":"2024-09-21T07:32:51.319793+0000","last_became_peered":"2024-09-21T07:32:51.319793+0000","last_unstale":"2024-09-21T07:33:33.932830+0000","last_undegraded":"2024-09-21T07:33:33.932830+0000","last_fullsized":"2024-09-21T07:33:33.932830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.839505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962512+0000","last_change":"2024-09-21T07:32:51.313478+0000","last_active":"2024-09-21T07:33:33.962512+0000","last_peered":"2024-09-21T07:33:33.962512+0000","last_clean":"2024-09-21T07:33:33.962512+0000","last_became_active":"2024-09-21T07:32:51.313112+0000","last_became_peered":"2024-09-21T07:32:51.313112+0000","last_unstale":"2024-09-21T07:33:33.962512+0000","last_undegraded":"2024-09-21T07:33:33.962512+0000","last_fullsized":"2024-09-21T07:33:33.962512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.064888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.927961+0000","last_change":"2024-09-21T07:32:53.322252+0000","last_active":"2024-09-21T07:33:33.927961+0000","last_peered":"2024-09-21T07:33:33.927961+0000","last_clean":"2024-09-21T07:33:33.927961+0000","last_became_active":"2024-09-21T07:32:53.321919+0000","last_became_peered":"2024-09-21T07:32:53.321919+0000","last_unstale":"2024-09-21T07:33:33.927961+0000","last_undegraded":"2024-09-21T07:33:33.927961+0000","last_fullsized":"2024-09-21T07:33:33.927961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:15.852678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935562+0000","last_change":"2024-09-21T07:32:51.322190+0000","last_active":"2024-09-21T07:33:33.935562+0000","last_peered":"2024-09-21T07:33:33.935562+0000","last_clean":"2024-09-21T07:33:33.935562+0000","last_became_active":"2024-09-21T07:32:51.321307+0000","last_became_peered":"2024-09-21T07:32:51.321307+0000","last_unstale":"2024-09-21T07:33:33.935562+0000","last_undegraded":"2024-09-21T07:33:33.935562+0000","last_fullsized":"2024-09-21T07:33:33.935562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:23.029068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929552+0000","last_change":"2024-09-21T07:32:53.323650+0000","last_active":"2024-09-21T07:33:33.929552+0000","last_peered":"2024-09-21T07:33:33.929552+0000","last_clean":"2024-09-21T07:33:33.929552+0000","last_became_active":"2024-09-21T07:32:53.323304+0000","last_became_peered":"2024-09-21T07:32:53.323304+0000","last_unstale":"2024-09-21T07:33:33.929552+0000","last_undegraded":"2024-09-21T07:33:33.929552+0000","last_fullsized":"2024-09-21T07:33:33.929552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.229852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:54.970112+0000","last_change":"2024-09-21T07:32:51.319021+0000","last_active":"2024-09-21T07:33:54.970112+0000","last_peered":"2024-09-21T07:33:54.970112+0000","last_clean":"2024-09-21T07:33:54.970112+0000","last_became_active":"2024-09-21T07:32:51.318150+0000","last_became_peered":"2024-09-21T07:32:51.318150+0000","last_unstale":"2024-09-21T07:33:54.970112+0000","last_undegraded":"2024-09-21T07:33:54.970112+0000","last_fullsized":"2024-09-21T07:33:54.970112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.408401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936806+0000","last_change":"2024-09-21T07:32:53.327203+0000","last_active":"2024-09-21T07:33:33.936806+0000","last_peered":"2024-09-21T07:33:33.936806+0000","last_clean":"2024-09-21T07:33:33.936806+0000","last_became_active":"2024-09-21T07:32:53.326784+0000","last_became_peered":"2024-09-21T07:32:53.326784+0000","last_unstale":"2024-09-21T07:33:33.936806+0000","last_undegraded":"2024-09-21T07:33:33.936806+0000","last_fullsized":"2024-09-21T07:33:33.936806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.468948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931305+0000","last_change":"2024-09-21T07:32:51.314749+0000","last_active":"2024-09-21T07:33:33.931305+0000","last_peered":"2024-09-21T07:33:33.931305+0000","last_clean":"2024-09-21T07:33:33.931305+0000","last_became_active":"2024-09-21T07:32:51.314181+0000","last_became_peered":"2024-09-21T07:32:51.314181+0000","last_unstale":"2024-09-21T07:33:33.931305+0000","last_undegraded":"2024-09-21T07:33:33.931305+0000","last_fullsized":"2024-09-21T07:33:33.931305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:22.541053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934625+0000","last_change":"2024-09-21T07:32:53.334410+0000","last_active":"2024-09-21T07:33:33.934625+0000","last_peered":"2024-09-21T07:33:33.934625+0000","last_clean":"2024-09-21T07:33:33.934625+0000","last_became_active":"2024-09-21T07:32:53.334000+0000","last_became_peered":"2024-09-21T07:32:53.334000+0000","last_unstale":"2024-09-21T07:33:33.934625+0000","last_undegraded":"2024-09-21T07:33:33.934625+0000","last_fullsized":"2024-09-21T07:33:33.934625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:11.316706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935796+0000","last_change":"2024-09-21T07:32:51.959823+0000","last_active":"2024-09-21T07:33:33.935796+0000","last_peered":"2024-09-21T07:33:33.935796+0000","last_clean":"2024-09-21T07:33:33.935796+0000","last_became_active":"2024-09-21T07:32:51.959435+0000","last_became_peered":"2024-09-21T07:32:51.959435+0000","last_unstale":"2024-09-21T07:33:33.935796+0000","last_undegraded":"2024-09-21T07:33:33.935796+0000","last_fullsized":"2024-09-21T07:33:33.935796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:46.394422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936310+0000","last_change":"2024-09-21T07:32:53.334201+0000","last_active":"2024-09-21T07:33:33.936310+0000","last_peered":"2024-09-21T07:33:33.936310+0000","last_clean":"2024-09-21T07:33:33.936310+0000","last_became_active":"2024-09-21T07:32:53.333815+0000","last_became_peered":"2024-09-21T07:32:53.333815+0000","last_unstale":"2024-09-21T07:33:33.936310+0000","last_undegraded":"2024-09-21T07:33:33.936310+0000","last_fullsized":"2024-09-21T07:33:33.936310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:48.783373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'27","reported_seq":183,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:55.971498+0000","last_change":"2024-09-21T07:33:33.948762+0000","last_active":"2024-09-21T07:33:55.971498+0000","last_peered":"2024-09-21T07:33:55.971498+0000","last_clean":"2024-09-21T07:33:55.971498+0000","last_became_active":"2024-09-21T07:33:33.936931+0000","last_became_peered":"2024-09-21T07:33:33.936931+0000","last_unstale":"2024-09-21T07:33:55.971498+0000","last_undegraded":"2024-09-21T07:33:55.971498+0000","last_fullsized":"2024-09-21T07:33:55.971498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:14.292835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":117,"num_write":28,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":63902,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930070+0000","last_change":"2024-09-21T07:32:53.326999+0000","last_active":"2024-09-21T07:33:33.930070+0000","last_peered":"2024-09-21T07:33:33.930070+0000","last_clean":"2024-09-21T07:33:33.930070+0000","last_became_active":"2024-09-21T07:32:53.326550+0000","last_became_peered":"2024-09-21T07:32:53.326550+0000","last_unstale":"2024-09-21T07:33:33.930070+0000","last_undegraded":"2024-09-21T07:33:33.930070+0000","last_fullsized":"2024-09-21T07:33:33.930070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:12.036977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935744+0000","last_change":"2024-09-21T07:32:51.317687+0000","last_active":"2024-09-21T07:33:33.935744+0000","last_peered":"2024-09-21T07:33:33.935744+0000","last_clean":"2024-09-21T07:33:33.935744+0000","last_became_active":"2024-09-21T07:32:51.316986+0000","last_became_peered":"2024-09-21T07:32:51.316986+0000","last_unstale":"2024-09-21T07:33:33.935744+0000","last_undegraded":"2024-09-21T07:33:33.935744+0000","last_fullsized":"2024-09-21T07:33:33.935744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:39.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962558+0000","last_change":"2024-09-21T07:32:53.323562+0000","last_active":"2024-09-21T07:33:33.962558+0000","last_peered":"2024-09-21T07:33:33.962558+0000","last_clean":"2024-09-21T07:33:33.962558+0000","last_became_active":"2024-09-21T07:32:53.323106+0000","last_became_peered":"2024-09-21T07:32:53.323106+0000","last_unstale":"2024-09-21T07:33:33.962558+0000","last_undegraded":"2024-09-21T07:33:33.962558+0000","last_fullsized":"2024-09-21T07:33:33.962558+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:24.607014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934561+0000","last_change":"2024-09-21T07:32:51.320887+0000","last_active":"2024-09-21T07:33:33.934561+0000","last_peered":"2024-09-21T07:33:33.934561+0000","last_clean":"2024-09-21T07:33:33.934561+0000","last_became_active":"2024-09-21T07:32:51.319706+0000","last_became_peered":"2024-09-21T07:32:51.319706+0000","last_unstale":"2024-09-21T07:33:33.934561+0000","last_undegraded":"2024-09-21T07:33:33.934561+0000","last_fullsized":"2024-09-21T07:33:33.934561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:49.594900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.963836+0000","last_change":"2024-09-21T07:33:33.963764+0000","last_active":"2024-09-21T07:33:33.963836+0000","last_peered":"2024-09-21T07:33:33.963836+0000","last_clean":"2024-09-21T07:33:33.963836+0000","last_became_active":"2024-09-21T07:33:33.963393+0000","last_became_peered":"2024-09-21T07:33:33.963393+0000","last_unstale":"2024-09-21T07:33:33.963836+0000","last_undegraded":"2024-09-21T07:33:33.963836+0000","last_fullsized":"2024-09-21T07:33:33.963836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:16.691302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":84,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:55.477703+0000","last_change":"2024-09-21T07:32:51.319604+0000","last_active":"2024-09-21T07:33:55.477703+0000","last_peered":"2024-09-21T07:33:55.477703+0000","last_clean":"2024-09-21T07:33:55.477703+0000","last_became_active":"2024-09-21T07:32:51.319226+0000","last_became_peered":"2024-09-21T07:32:51.319226+0000","last_unstale":"2024-09-21T07:33:55.477703+0000","last_undegraded":"2024-09-21T07:33:55.477703+0000","last_fullsized":"2024-09-21T07:33:55.477703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:21.724229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930887+0000","last_change":"2024-09-21T07:32:53.332607+0000","last_active":"2024-09-21T07:33:33.930887+0000","last_peered":"2024-09-21T07:33:33.930887+0000","last_clean":"2024-09-21T07:33:33.930887+0000","last_became_active":"2024-09-21T07:32:53.332272+0000","last_became_peered":"2024-09-21T07:32:53.332272+0000","last_unstale":"2024-09-21T07:33:33.930887+0000","last_undegraded":"2024-09-21T07:33:33.930887+0000","last_fullsized":"2024-09-21T07:33:33.930887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:57.193207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.953877+0000","last_change":"2024-09-21T07:33:33.953779+0000","last_active":"2024-09-21T07:33:33.953877+0000","last_peered":"2024-09-21T07:33:33.953877+0000","last_clean":"2024-09-21T07:33:33.953877+0000","last_became_active":"2024-09-21T07:33:33.939419+0000","last_became_peered":"2024-09-21T07:33:33.939419+0000","last_unstale":"2024-09-21T07:33:33.953877+0000","last_undegraded":"2024-09-21T07:33:33.953877+0000","last_fullsized":"2024-09-21T07:33:33.953877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934237+0000","last_change":"2024-09-21T07:32:53.340603+0000","last_active":"2024-09-21T07:33:33.934237+0000","last_peered":"2024-09-21T07:33:33.934237+0000","last_clean":"2024-09-21T07:33:33.934237+0000","last_became_active":"2024-09-21T07:32:53.339451+0000","last_became_peered":"2024-09-21T07:32:53.339451+0000","last_unstale":"2024-09-21T07:33:33.934237+0000","last_undegraded":"2024-09-21T07:33:33.934237+0000","last_fullsized":"2024-09-21T07:33:33.934237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:50.895945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929766+0000","last_change":"2024-09-21T07:32:51.321912+0000","last_active":"2024-09-21T07:33:33.929766+0000","last_peered":"2024-09-21T07:33:33.929766+0000","last_clean":"2024-09-21T07:33:33.929766+0000","last_became_active":"2024-09-21T07:32:51.320880+0000","last_became_peered":"2024-09-21T07:32:51.320880+0000","last_unstale":"2024-09-21T07:33:33.929766+0000","last_undegraded":"2024-09-21T07:33:33.929766+0000","last_fullsized":"2024-09-21T07:33:33.929766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:05.538597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931507+0000","last_change":"2024-09-21T07:32:53.332894+0000","last_active":"2024-09-21T07:33:33.931507+0000","last_peered":"2024-09-21T07:33:33.931507+0000","last_clean":"2024-09-21T07:33:33.931507+0000","last_became_active":"2024-09-21T07:32:53.332489+0000","last_became_peered":"2024-09-21T07:32:53.332489+0000","last_unstale":"2024-09-21T07:33:33.931507+0000","last_undegraded":"2024-09-21T07:33:33.931507+0000","last_fullsized":"2024-09-21T07:33:33.931507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:18.312560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962818+0000","last_change":"2024-09-21T07:32:51.313363+0000","last_active":"2024-09-21T07:33:33.962818+0000","last_peered":"2024-09-21T07:33:33.962818+0000","last_clean":"2024-09-21T07:33:33.962818+0000","last_became_active":"2024-09-21T07:32:51.313001+0000","last_became_peered":"2024-09-21T07:32:51.313001+0000","last_unstale":"2024-09-21T07:33:33.962818+0000","last_undegraded":"2024-09-21T07:33:33.962818+0000","last_fullsized":"2024-09-21T07:33:33.962818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:58.056561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931933+0000","last_change":"2024-09-21T07:32:53.325791+0000","last_active":"2024-09-21T07:33:33.931933+0000","last_peered":"2024-09-21T07:33:33.931933+0000","last_clean":"2024-09-21T07:33:33.931933+0000","last_became_active":"2024-09-21T07:32:53.325406+0000","last_became_peered":"2024-09-21T07:32:53.325406+0000","last_unstale":"2024-09-21T07:33:33.931933+0000","last_undegraded":"2024-09-21T07:33:33.931933+0000","last_fullsized":"2024-09-21T07:33:33.931933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.915438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935678+0000","last_change":"2024-09-21T07:32:51.318862+0000","last_active":"2024-09-21T07:33:33.935678+0000","last_peered":"2024-09-21T07:33:33.935678+0000","last_clean":"2024-09-21T07:33:33.935678+0000","last_became_active":"2024-09-21T07:32:51.318423+0000","last_became_peered":"2024-09-21T07:32:51.318423+0000","last_unstale":"2024-09-21T07:33:33.935678+0000","last_undegraded":"2024-09-21T07:33:33.935678+0000","last_fullsized":"2024-09-21T07:33:33.935678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:57.438214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931111+0000","last_change":"2024-09-21T07:32:53.333475+0000","last_active":"2024-09-21T07:33:33.931111+0000","last_peered":"2024-09-21T07:33:33.931111+0000","last_clean":"2024-09-21T07:33:33.931111+0000","last_became_active":"2024-09-21T07:32:53.333039+0000","last_became_peered":"2024-09-21T07:32:53.333039+0000","last_unstale":"2024-09-21T07:33:33.931111+0000","last_undegraded":"2024-09-21T07:33:33.931111+0000","last_fullsized":"2024-09-21T07:33:33.931111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:39.510813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937280+0000","last_change":"2024-09-21T07:32:51.958898+0000","last_active":"2024-09-21T07:33:33.937280+0000","last_peered":"2024-09-21T07:33:33.937280+0000","last_clean":"2024-09-21T07:33:33.937280+0000","last_became_active":"2024-09-21T07:32:51.958411+0000","last_became_peered":"2024-09-21T07:32:51.958411+0000","last_unstale":"2024-09-21T07:33:33.937280+0000","last_undegraded":"2024-09-21T07:33:33.937280+0000","last_fullsized":"2024-09-21T07:33:33.937280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:12.375874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931235+0000","last_change":"2024-09-21T07:32:53.331327+0000","last_active":"2024-09-21T07:33:33.931235+0000","last_peered":"2024-09-21T07:33:33.931235+0000","last_clean":"2024-09-21T07:33:33.931235+0000","last_became_active":"2024-09-21T07:32:53.329449+0000","last_became_peered":"2024-09-21T07:32:53.329449+0000","last_unstale":"2024-09-21T07:33:33.931235+0000","last_undegraded":"2024-09-21T07:33:33.931235+0000","last_fullsized":"2024-09-21T07:33:33.931235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:20.605458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931646+0000","last_change":"2024-09-21T07:31:42.854046+0000","last_active":"2024-09-21T07:33:33.931646+0000","last_peered":"2024-09-21T07:33:33.931646+0000","last_clean":"2024-09-21T07:33:33.931646+0000","last_became_active":"2024-09-21T07:31:42.847659+0000","last_became_peered":"2024-09-21T07:31:42.847659+0000","last_unstale":"2024-09-21T07:33:33.931646+0000","last_undegraded":"2024-09-21T07:33:33.931646+0000","last_fullsized":"2024-09-21T07:33:33.931646+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_clean_scrub_stamp":"2024-09-21T07:28:23.379848+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:17.782511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929108+0000","last_change":"2024-09-21T07:32:51.316842+0000","last_active":"2024-09-21T07:33:33.929108+0000","last_peered":"2024-09-21T07:33:33.929108+0000","last_clean":"2024-09-21T07:33:33.929108+0000","last_became_active":"2024-09-21T07:32:51.316409+0000","last_became_peered":"2024-09-21T07:32:51.316409+0000","last_unstale":"2024-09-21T07:33:33.929108+0000","last_undegraded":"2024-09-21T07:33:33.929108+0000","last_fullsized":"2024-09-21T07:33:33.929108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.648952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928056+0000","last_change":"2024-09-21T07:32:53.331632+0000","last_active":"2024-09-21T07:33:33.928056+0000","last_peered":"2024-09-21T07:33:33.928056+0000","last_clean":"2024-09-21T07:33:33.928056+0000","last_became_active":"2024-09-21T07:32:53.331071+0000","last_became_peered":"2024-09-21T07:32:53.331071+0000","last_unstale":"2024-09-21T07:33:33.928056+0000","last_undegraded":"2024-09-21T07:33:33.928056+0000","last_fullsized":"2024-09-21T07:33:33.928056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:41.568187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931505+0000","last_change":"2024-09-21T07:32:51.319580+0000","last_active":"2024-09-21T07:33:33.931505+0000","last_peered":"2024-09-21T07:33:33.931505+0000","last_clean":"2024-09-21T07:33:33.931505+0000","last_became_active":"2024-09-21T07:32:51.319199+0000","last_became_peered":"2024-09-21T07:32:51.319199+0000","last_unstale":"2024-09-21T07:33:33.931505+0000","last_undegraded":"2024-09-21T07:33:33.931505+0000","last_fullsized":"2024-09-21T07:33:33.931505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.851480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962507+0000","last_change":"2024-09-21T07:32:53.330969+0000","last_active":"2024-09-21T07:33:33.962507+0000","last_peered":"2024-09-21T07:33:33.962507+0000","last_clean":"2024-09-21T07:33:33.962507+0000","last_became_active":"2024-09-21T07:32:53.329772+0000","last_became_peered":"2024-09-21T07:32:53.329772+0000","last_unstale":"2024-09-21T07:33:33.962507+0000","last_undegraded":"2024-09-21T07:33:33.962507+0000","last_fullsized":"2024-09-21T07:33:33.962507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:23.790114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:55.476689+0000","last_change":"2024-09-21T07:32:51.958596+0000","last_active":"2024-09-21T07:33:55.476689+0000","last_peered":"2024-09-21T07:33:55.476689+0000","last_clean":"2024-09-21T07:33:55.476689+0000","last_became_active":"2024-09-21T07:32:51.958140+0000","last_became_peered":"2024-09-21T07:32:51.958140+0000","last_unstale":"2024-09-21T07:33:55.476689+0000","last_undegraded":"2024-09-21T07:33:55.476689+0000","last_fullsized":"2024-09-21T07:33:55.476689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:43.697003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935319+0000","last_change":"2024-09-21T07:32:53.340627+0000","last_active":"2024-09-21T07:33:33.935319+0000","last_peered":"2024-09-21T07:33:33.935319+0000","last_clean":"2024-09-21T07:33:33.935319+0000","last_became_active":"2024-09-21T07:32:53.340095+0000","last_became_peered":"2024-09-21T07:32:53.340095+0000","last_unstale":"2024-09-21T07:33:33.935319+0000","last_undegraded":"2024-09-21T07:33:33.935319+0000","last_fullsized":"2024-09-21T07:33:33.935319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:55.053809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931356+0000","last_change":"2024-09-21T07:32:51.316441+0000","last_active":"2024-09-21T07:33:33.931356+0000","last_peered":"2024-09-21T07:33:33.931356+0000","last_clean":"2024-09-21T07:33:33.931356+0000","last_became_active":"2024-09-21T07:32:51.315920+0000","last_became_peered":"2024-09-21T07:32:51.315920+0000","last_unstale":"2024-09-21T07:33:33.931356+0000","last_undegraded":"2024-09-21T07:33:33.931356+0000","last_fullsized":"2024-09-21T07:33:33.931356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:06.459155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.933378+0000","last_change":"2024-09-21T07:32:53.338859+0000","last_active":"2024-09-21T07:33:33.933378+0000","last_peered":"2024-09-21T07:33:33.933378+0000","last_clean":"2024-09-21T07:33:33.933378+0000","last_became_active":"2024-09-21T07:32:53.338332+0000","last_became_peered":"2024-09-21T07:32:53.338332+0000","last_unstale":"2024-09-21T07:33:33.933378+0000","last_undegraded":"2024-09-21T07:33:33.933378+0000","last_fullsized":"2024-09-21T07:33:33.933378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.852758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929776+0000","last_change":"2024-09-21T07:32:51.959081+0000","last_active":"2024-09-21T07:33:33.929776+0000","last_peered":"2024-09-21T07:33:33.929776+0000","last_clean":"2024-09-21T07:33:33.929776+0000","last_became_active":"2024-09-21T07:32:51.958701+0000","last_became_peered":"2024-09-21T07:32:51.958701+0000","last_unstale":"2024-09-21T07:33:33.929776+0000","last_undegraded":"2024-09-21T07:33:33.929776+0000","last_fullsized":"2024-09-21T07:33:33.929776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:56.216119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932974+0000","last_change":"2024-09-21T07:32:53.328300+0000","last_active":"2024-09-21T07:33:33.932974+0000","last_peered":"2024-09-21T07:33:33.932974+0000","last_clean":"2024-09-21T07:33:33.932974+0000","last_became_active":"2024-09-21T07:32:53.327485+0000","last_became_peered":"2024-09-21T07:32:53.327485+0000","last_unstale":"2024-09-21T07:33:33.932974+0000","last_undegraded":"2024-09-21T07:33:33.932974+0000","last_fullsized":"2024-09-21T07:33:33.932974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:46.958341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.941364+0000","last_change":"2024-09-21T07:33:33.941286+0000","last_active":"2024-09-21T07:33:33.941364+0000","last_peered":"2024-09-21T07:33:33.941364+0000","last_clean":"2024-09-21T07:33:33.941364+0000","last_became_active":"2024-09-21T07:33:33.936016+0000","last_became_peered":"2024-09-21T07:33:33.936016+0000","last_unstale":"2024-09-21T07:33:33.941364+0000","last_undegraded":"2024-09-21T07:33:33.941364+0000","last_fullsized":"2024-09-21T07:33:33.941364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:54.453199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962772+0000","last_change":"2024-09-21T07:32:53.316991+0000","last_active":"2024-09-21T07:33:33.962772+0000","last_peered":"2024-09-21T07:33:33.962772+0000","last_clean":"2024-09-21T07:33:33.962772+0000","last_became_active":"2024-09-21T07:32:53.316588+0000","last_became_peered":"2024-09-21T07:32:53.316588+0000","last_unstale":"2024-09-21T07:33:33.962772+0000","last_undegraded":"2024-09-21T07:33:33.962772+0000","last_fullsized":"2024-09-21T07:33:33.962772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:04.766114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929876+0000","last_change":"2024-09-21T07:32:51.317544+0000","last_active":"2024-09-21T07:33:33.929876+0000","last_peered":"2024-09-21T07:33:33.929876+0000","last_clean":"2024-09-21T07:33:33.929876+0000","last_became_active":"2024-09-21T07:32:51.317091+0000","last_became_peered":"2024-09-21T07:32:51.317091+0000","last_unstale":"2024-09-21T07:33:33.929876+0000","last_undegraded":"2024-09-21T07:33:33.929876+0000","last_fullsized":"2024-09-21T07:33:33.929876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:25.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928395+0000","last_change":"2024-09-21T07:32:53.328118+0000","last_active":"2024-09-21T07:33:33.928395+0000","last_peered":"2024-09-21T07:33:33.928395+0000","last_clean":"2024-09-21T07:33:33.928395+0000","last_became_active":"2024-09-21T07:32:53.327755+0000","last_became_peered":"2024-09-21T07:32:53.327755+0000","last_unstale":"2024-09-21T07:33:33.928395+0000","last_undegraded":"2024-09-21T07:33:33.928395+0000","last_fullsized":"2024-09-21T07:33:33.928395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:00.655258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929351+0000","last_change":"2024-09-21T07:32:51.566524+0000","last_active":"2024-09-21T07:33:33.929351+0000","last_peered":"2024-09-21T07:33:33.929351+0000","last_clean":"2024-09-21T07:33:33.929351+0000","last_became_active":"2024-09-21T07:32:51.566115+0000","last_became_peered":"2024-09-21T07:32:51.566115+0000","last_unstale":"2024-09-21T07:33:33.929351+0000","last_undegraded":"2024-09-21T07:33:33.929351+0000","last_fullsized":"2024-09-21T07:33:33.929351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:01.098512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934494+0000","last_change":"2024-09-21T07:32:53.334275+0000","last_active":"2024-09-21T07:33:33.934494+0000","last_peered":"2024-09-21T07:33:33.934494+0000","last_clean":"2024-09-21T07:33:33.934494+0000","last_became_active":"2024-09-21T07:32:53.333842+0000","last_became_peered":"2024-09-21T07:32:53.333842+0000","last_unstale":"2024-09-21T07:33:33.934494+0000","last_undegraded":"2024-09-21T07:33:33.934494+0000","last_fullsized":"2024-09-21T07:33:33.934494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:21.370325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936050+0000","last_change":"2024-09-21T07:32:51.959211+0000","last_active":"2024-09-21T07:33:33.936050+0000","last_peered":"2024-09-21T07:33:33.936050+0000","last_clean":"2024-09-21T07:33:33.936050+0000","last_became_active":"2024-09-21T07:32:51.958887+0000","last_became_peered":"2024-09-21T07:32:51.958887+0000","last_unstale":"2024-09-21T07:33:33.936050+0000","last_undegraded":"2024-09-21T07:33:33.936050+0000","last_fullsized":"2024-09-21T07:33:33.936050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:22.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929535+0000","last_change":"2024-09-21T07:32:53.323125+0000","last_active":"2024-09-21T07:33:33.929535+0000","last_peered":"2024-09-21T07:33:33.929535+0000","last_clean":"2024-09-21T07:33:33.929535+0000","last_became_active":"2024-09-21T07:32:53.322746+0000","last_became_peered":"2024-09-21T07:32:53.322746+0000","last_unstale":"2024-09-21T07:33:33.929535+0000","last_undegraded":"2024-09-21T07:33:33.929535+0000","last_fullsized":"2024-09-21T07:33:33.929535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:53.957518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928087+0000","last_change":"2024-09-21T07:32:51.314786+0000","last_active":"2024-09-21T07:33:33.928087+0000","last_peered":"2024-09-21T07:33:33.928087+0000","last_clean":"2024-09-21T07:33:33.928087+0000","last_became_active":"2024-09-21T07:32:51.314436+0000","last_became_peered":"2024-09-21T07:32:51.314436+0000","last_unstale":"2024-09-21T07:33:33.928087+0000","last_undegraded":"2024-09-21T07:33:33.928087+0000","last_fullsized":"2024-09-21T07:33:33.928087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:39.672746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932539+0000","last_change":"2024-09-21T07:32:53.332759+0000","last_active":"2024-09-21T07:33:33.932539+0000","last_peered":"2024-09-21T07:33:33.932539+0000","last_clean":"2024-09-21T07:33:33.932539+0000","last_became_active":"2024-09-21T07:32:53.332353+0000","last_became_peered":"2024-09-21T07:32:53.332353+0000","last_unstale":"2024-09-21T07:33:33.932539+0000","last_undegraded":"2024-09-21T07:33:33.932539+0000","last_fullsized":"2024-09-21T07:33:33.932539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:22.561528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936531+0000","last_change":"2024-09-21T07:32:51.318180+0000","last_active":"2024-09-21T07:33:33.936531+0000","last_peered":"2024-09-21T07:33:33.936531+0000","last_clean":"2024-09-21T07:33:33.936531+0000","last_became_active":"2024-09-21T07:32:51.317630+0000","last_became_peered":"2024-09-21T07:32:51.317630+0000","last_unstale":"2024-09-21T07:33:33.936531+0000","last_undegraded":"2024-09-21T07:33:33.936531+0000","last_fullsized":"2024-09-21T07:33:33.936531+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.976579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928164+0000","last_change":"2024-09-21T07:32:53.326166+0000","last_active":"2024-09-21T07:33:33.928164+0000","last_peered":"2024-09-21T07:33:33.928164+0000","last_clean":"2024-09-21T07:33:33.928164+0000","last_became_active":"2024-09-21T07:32:53.325797+0000","last_became_peered":"2024-09-21T07:32:53.325797+0000","last_unstale":"2024-09-21T07:33:33.928164+0000","last_undegraded":"2024-09-21T07:33:33.928164+0000","last_fullsized":"2024-09-21T07:33:33.928164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:43.130088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929619+0000","last_change":"2024-09-21T07:32:51.323554+0000","last_active":"2024-09-21T07:33:33.929619+0000","last_peered":"2024-09-21T07:33:33.929619+0000","last_clean":"2024-09-21T07:33:33.929619+0000","last_became_active":"2024-09-21T07:32:51.322847+0000","last_became_peered":"2024-09-21T07:32:51.322847+0000","last_unstale":"2024-09-21T07:33:33.929619+0000","last_undegraded":"2024-09-21T07:33:33.929619+0000","last_fullsized":"2024-09-21T07:33:33.929619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:23.102513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931214+0000","last_change":"2024-09-21T07:32:53.330124+0000","last_active":"2024-09-21T07:33:33.931214+0000","last_peered":"2024-09-21T07:33:33.931214+0000","last_clean":"2024-09-21T07:33:33.931214+0000","last_became_active":"2024-09-21T07:32:53.329497+0000","last_became_peered":"2024-09-21T07:32:53.329497+0000","last_unstale":"2024-09-21T07:33:33.931214+0000","last_undegraded":"2024-09-21T07:33:33.931214+0000","last_fullsized":"2024-09-21T07:33:33.931214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:40.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935351+0000","last_change":"2024-09-21T07:32:53.340492+0000","last_active":"2024-09-21T07:33:33.935351+0000","last_peered":"2024-09-21T07:33:33.935351+0000","last_clean":"2024-09-21T07:33:33.935351+0000","last_became_active":"2024-09-21T07:32:53.339535+0000","last_became_peered":"2024-09-21T07:32:53.339535+0000","last_unstale":"2024-09-21T07:33:33.935351+0000","last_undegraded":"2024-09-21T07:33:33.935351+0000","last_fullsized":"2024-09-21T07:33:33.935351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:01.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929995+0000","last_change":"2024-09-21T07:32:51.321423+0000","last_active":"2024-09-21T07:33:33.929995+0000","last_peered":"2024-09-21T07:33:33.929995+0000","last_clean":"2024-09-21T07:33:33.929995+0000","last_became_active":"2024-09-21T07:32:51.320844+0000","last_became_peered":"2024-09-21T07:32:51.320844+0000","last_unstale":"2024-09-21T07:33:33.929995+0000","last_undegraded":"2024-09-21T07:33:33.929995+0000","last_fullsized":"2024-09-21T07:33:33.929995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.771991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936123+0000","last_change":"2024-09-21T07:32:53.337661+0000","last_active":"2024-09-21T07:33:33.936123+0000","last_peered":"2024-09-21T07:33:33.936123+0000","last_clean":"2024-09-21T07:33:33.936123+0000","last_became_active":"2024-09-21T07:32:53.337269+0000","last_became_peered":"2024-09-21T07:32:53.337269+0000","last_unstale":"2024-09-21T07:33:33.936123+0000","last_undegraded":"2024-09-21T07:33:33.936123+0000","last_fullsized":"2024-09-21T07:33:33.936123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:31.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930070+0000","last_change":"2024-09-21T07:32:51.323429+0000","last_active":"2024-09-21T07:33:33.930070+0000","last_peered":"2024-09-21T07:33:33.930070+0000","last_clean":"2024-09-21T07:33:33.930070+0000","last_became_active":"2024-09-21T07:32:51.323037+0000","last_became_peered":"2024-09-21T07:32:51.323037+0000","last_unstale":"2024-09-21T07:33:33.930070+0000","last_undegraded":"2024-09-21T07:33:33.930070+0000","last_fullsized":"2024-09-21T07:33:33.930070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:38.797479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934594+0000","last_change":"2024-09-21T07:32:53.327544+0000","last_active":"2024-09-21T07:33:33.934594+0000","last_peered":"2024-09-21T07:33:33.934594+0000","last_clean":"2024-09-21T07:33:33.934594+0000","last_became_active":"2024-09-21T07:32:53.326960+0000","last_became_peered":"2024-09-21T07:32:53.326960+0000","last_unstale":"2024-09-21T07:33:33.934594+0000","last_undegraded":"2024-09-21T07:33:33.934594+0000","last_fullsized":"2024-09-21T07:33:33.934594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:47.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928575+0000","last_change":"2024-09-21T07:32:51.959814+0000","last_active":"2024-09-21T07:33:33.928575+0000","last_peered":"2024-09-21T07:33:33.928575+0000","last_clean":"2024-09-21T07:33:33.928575+0000","last_became_active":"2024-09-21T07:32:51.957948+0000","last_became_peered":"2024-09-21T07:32:51.957948+0000","last_unstale":"2024-09-21T07:33:33.928575+0000","last_undegraded":"2024-09-21T07:33:33.928575+0000","last_fullsized":"2024-09-21T07:33:33.928575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:34.949022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928388+0000","last_change":"2024-09-21T07:32:53.328689+0000","last_active":"2024-09-21T07:33:33.928388+0000","last_peered":"2024-09-21T07:33:33.928388+0000","last_clean":"2024-09-21T07:33:33.928388+0000","last_became_active":"2024-09-21T07:32:53.328340+0000","last_became_peered":"2024-09-21T07:32:53.328340+0000","last_unstale":"2024-09-21T07:33:33.928388+0000","last_undegraded":"2024-09-21T07:33:33.928388+0000","last_fullsized":"2024-09-21T07:33:33.928388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:11.294632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929953+0000","last_change":"2024-09-21T07:32:51.317674+0000","last_active":"2024-09-21T07:33:33.929953+0000","last_peered":"2024-09-21T07:33:33.929953+0000","last_clean":"2024-09-21T07:33:33.929953+0000","last_became_active":"2024-09-21T07:32:51.317097+0000","last_became_peered":"2024-09-21T07:32:51.317097+0000","last_unstale":"2024-09-21T07:33:33.929953+0000","last_undegraded":"2024-09-21T07:33:33.929953+0000","last_fullsized":"2024-09-21T07:33:33.929953+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.144187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67903,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":341,"num_read_kb":241,"num_write":160,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":64658,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":400556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":31914435},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1519616,"data_stored":1056196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135907,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":400658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":823296,"data_stored":400444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712564,"statfs":{"total":95995035648,"available":95961665536,"internally_reserved":0,"allocated":1429504,"data_stored":992508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40316,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704836,"statfs":{"total":95995035648,"available":95953752064,"internally_reserved":0,"allocated":823296,"data_stored":400047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712556,"statfs":{"total":95995035648,"available":95961657344,"internally_reserved":0,"allocated":1441792,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":465399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":400358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":400568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607629,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":463742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":401318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:33:59.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:33:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:00.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:00.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: from='client.24878 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:34:00.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:34:00.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:34:00.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:33:59 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:00.047 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: from='client.24878 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:34:00.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:34:00.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:34:00.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:33:59 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: from='client.24878 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:34:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:33:59 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:34:00.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.138+0000 7fe402249640 1 -- 172.21.15.60:0/4014728382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc105ac0 msgr2=0x7fe3fc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.138+0000 7fe402249640 1 --2- 172.21.15.60:0/4014728382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc10f530 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009900 tx=0x7fe3f402a410 comp rx=0 tx=0).stop 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 -- 172.21.15.60:0/4014728382 shutdown_connections 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 --2- 172.21.15.60:0/4014728382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc10f530 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 --2- 172.21.15.60:0/4014728382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105170 0x7fe3fc105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 --2- 172.21.15.60:0/4014728382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc103160 0x7fe3fc103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 -- 172.21.15.60:0/4014728382 >> 172.21.15.60:0/4014728382 conn(0x7fe3fc077c60 msgr2=0x7fe3fc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 -- 172.21.15.60:0/4014728382 shutdown_connections 2024-09-21T07:34:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 -- 172.21.15.60:0/4014728382 wait complete. 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.139+0000 7fe402249640 1 Processor -- start 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 -- start start 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 0x7fe3fc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc105170 0x7fe3fc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc1129c0 con 0x7fe3fc103160 2024-09-21T07:34:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc112840 con 0x7fe3fc105170 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe402249640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc112b40 con 0x7fe3fc105ac0 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe3fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 0x7fe3fc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe3fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 0x7fe3fc199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39190/0 (socket says 172.21.15.60:39190) 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.140+0000 7fe3fb7fe640 1 -- 172.21.15.60:0/2780982506 learned_addr learned my addr 172.21.15.60:0/2780982506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fbfff640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3faffd640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc105170 0x7fe3fc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fb7fe640 1 -- 172.21.15.60:0/2780982506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105ac0 msgr2=0x7fe3fc19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fb7fe640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fb7fe640 1 -- 172.21.15.60:0/2780982506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc105170 msgr2=0x7fe3fc199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fb7fe640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc105170 0x7fe3fc199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fb7fe640 1 -- 172.21.15.60:0/2780982506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc19f2e0 con 0x7fe3fc103160 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fbfff640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3fb7fe640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 0x7fe3fc199370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00ebc0 tx=0x7fe3ec007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec01c070 con 0x7fe3fc103160 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3ec007ca0 con 0x7fe3fc103160 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec017410 con 0x7fe3fc103160 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc19f5d0 con 0x7fe3fc103160 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.141+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc101dc0 con 0x7fe3fc103160 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.142+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc103570 con 0x7fe3fc103160 2024-09-21T07:34:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.144+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe3ec01f070 con 0x7fe3fc103160 2024-09-21T07:34:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.145+0000 7fe3f8ff9640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe3e40b65a0 0x7fe3e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.145+0000 7fe3faffd640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe3e40b65a0 0x7fe3e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:00.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.145+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fe3ec0e8820 con 0x7fe3fc103160 2024-09-21T07:34:00.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.145+0000 7fe3faffd640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe3e40b65a0 0x7fe3e40b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0005fd0 tx=0x7fe3f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.148+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe3ec0aef80 con 0x7fe3fc103160 2024-09-21T07:34:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.333+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3fc1028b0 con 0x7fe3e40b65a0 2024-09-21T07:34:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.338+0000 7fe3f8ff9640 1 -- 172.21.15.60:0/2780982506 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258712 (secure 0 0 0) 0x7fe3fc1028b0 con 0x7fe3e40b65a0 2024-09-21T07:34:00.342 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-21T07:34:00.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe3e40b65a0 msgr2=0x7fe3e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe3e40b65a0 0x7fe3e40b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0005fd0 tx=0x7fe3f0005850 comp rx=0 tx=0).stop 2024-09-21T07:34:00.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 msgr2=0x7fe3fc199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:00.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 0x7fe3fc199370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00ebc0 tx=0x7fe3ec007590 comp rx=0 tx=0).stop 2024-09-21T07:34:00.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 shutdown_connections 2024-09-21T07:34:00.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe3e40b65a0 0x7fe3e40b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3fc105ac0 0x7fe3fc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3fc105170 0x7fe3fc199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 --2- 172.21.15.60:0/2780982506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3fc103160 0x7fe3fc199370 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:00.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 >> 172.21.15.60:0/2780982506 conn(0x7fe3fc077c60 msgr2=0x7fe3fc1063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:00.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 shutdown_connections 2024-09-21T07:34:00.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:00.341+0000 7fe402249640 1 -- 172.21.15.60:0/2780982506 wait complete. 2024-09-21T07:34:00.959 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:00 smithi060 ceph-mon[31244]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:34:00.991 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-21T07:33:58.618933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658505,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":417,"num_read_kb":305,"num_write":285,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":3016498,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":394352,"kb_used_data":11736,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124547472,"statfs":{"total":1151940427776,"available":1151536611328,"internally_reserved":0,"allocated":12017664,"data_stored":6773595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19154,"internal_metadata":391492910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003377"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931621+0000","last_change":"2024-09-21T07:32:53.330750+0000","last_active":"2024-09-21T07:33:33.931621+0000","last_peered":"2024-09-21T07:33:33.931621+0000","last_clean":"2024-09-21T07:33:33.931621+0000","last_became_active":"2024-09-21T07:32:53.330371+0000","last_became_peered":"2024-09-21T07:32:53.330371+0000","last_unstale":"2024-09-21T07:33:33.931621+0000","last_undegraded":"2024-09-21T07:33:33.931621+0000","last_fullsized":"2024-09-21T07:33:33.931621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:53.413349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934385+0000","last_change":"2024-09-21T07:32:53.329867+0000","last_active":"2024-09-21T07:33:33.934385+0000","last_peered":"2024-09-21T07:33:33.934385+0000","last_clean":"2024-09-21T07:33:33.934385+0000","last_became_active":"2024-09-21T07:32:53.329126+0000","last_became_peered":"2024-09-21T07:32:53.329126+0000","last_unstale":"2024-09-21T07:33:33.934385+0000","last_undegraded":"2024-09-21T07:33:33.934385+0000","last_fullsized":"2024-09-21T07:33:33.934385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:42.184172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934310+0000","last_change":"2024-09-21T07:32:53.332835+0000","last_active":"2024-09-21T07:33:33.934310+0000","last_peered":"2024-09-21T07:33:33.934310+0000","last_clean":"2024-09-21T07:33:33.934310+0000","last_became_active":"2024-09-21T07:32:53.332453+0000","last_became_peered":"2024-09-21T07:32:53.332453+0000","last_unstale":"2024-09-21T07:33:33.934310+0000","last_undegraded":"2024-09-21T07:33:33.934310+0000","last_fullsized":"2024-09-21T07:33:33.934310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:09.376263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929381+0000","last_change":"2024-09-21T07:32:53.332373+0000","last_active":"2024-09-21T07:33:33.929381+0000","last_peered":"2024-09-21T07:33:33.929381+0000","last_clean":"2024-09-21T07:33:33.929381+0000","last_became_active":"2024-09-21T07:32:53.331879+0000","last_became_peered":"2024-09-21T07:32:53.331879+0000","last_unstale":"2024-09-21T07:33:33.929381+0000","last_undegraded":"2024-09-21T07:33:33.929381+0000","last_fullsized":"2024-09-21T07:33:33.929381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:23.843203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929436+0000","last_change":"2024-09-21T07:32:53.327490+0000","last_active":"2024-09-21T07:33:33.929436+0000","last_peered":"2024-09-21T07:33:33.929436+0000","last_clean":"2024-09-21T07:33:33.929436+0000","last_became_active":"2024-09-21T07:32:53.327040+0000","last_became_peered":"2024-09-21T07:32:53.327040+0000","last_unstale":"2024-09-21T07:33:33.929436+0000","last_undegraded":"2024-09-21T07:33:33.929436+0000","last_fullsized":"2024-09-21T07:33:33.929436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.621877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932753+0000","last_change":"2024-09-21T07:32:53.338026+0000","last_active":"2024-09-21T07:33:33.932753+0000","last_peered":"2024-09-21T07:33:33.932753+0000","last_clean":"2024-09-21T07:33:33.932753+0000","last_became_active":"2024-09-21T07:32:53.337091+0000","last_became_peered":"2024-09-21T07:32:53.337091+0000","last_unstale":"2024-09-21T07:33:33.932753+0000","last_undegraded":"2024-09-21T07:33:33.932753+0000","last_fullsized":"2024-09-21T07:33:33.932753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:23:02.363161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930962+0000","last_change":"2024-09-21T07:32:53.333109+0000","last_active":"2024-09-21T07:33:33.930962+0000","last_peered":"2024-09-21T07:33:33.930962+0000","last_clean":"2024-09-21T07:33:33.930962+0000","last_became_active":"2024-09-21T07:32:53.332726+0000","last_became_peered":"2024-09-21T07:32:53.332726+0000","last_unstale":"2024-09-21T07:33:33.930962+0000","last_undegraded":"2024-09-21T07:33:33.930962+0000","last_fullsized":"2024-09-21T07:33:33.930962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:06.553522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937745+0000","last_change":"2024-09-21T07:33:33.937243+0000","last_active":"2024-09-21T07:33:33.937745+0000","last_peered":"2024-09-21T07:33:33.937745+0000","last_clean":"2024-09-21T07:33:33.937745+0000","last_became_active":"2024-09-21T07:33:33.936782+0000","last_became_peered":"2024-09-21T07:33:33.936782+0000","last_unstale":"2024-09-21T07:33:33.937745+0000","last_undegraded":"2024-09-21T07:33:33.937745+0000","last_fullsized":"2024-09-21T07:33:33.937745+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:25.889641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937857+0000","last_change":"2024-09-21T07:32:53.333433+0000","last_active":"2024-09-21T07:33:33.937857+0000","last_peered":"2024-09-21T07:33:33.937857+0000","last_clean":"2024-09-21T07:33:33.937857+0000","last_became_active":"2024-09-21T07:32:53.332975+0000","last_became_peered":"2024-09-21T07:32:53.332975+0000","last_unstale":"2024-09-21T07:33:33.937857+0000","last_undegraded":"2024-09-21T07:33:33.937857+0000","last_fullsized":"2024-09-21T07:33:33.937857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:35.820439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.933322+0000","last_change":"2024-09-21T07:32:53.337488+0000","last_active":"2024-09-21T07:33:33.933322+0000","last_peered":"2024-09-21T07:33:33.933322+0000","last_clean":"2024-09-21T07:33:33.933322+0000","last_became_active":"2024-09-21T07:32:53.337104+0000","last_became_peered":"2024-09-21T07:32:53.337104+0000","last_unstale":"2024-09-21T07:33:33.933322+0000","last_undegraded":"2024-09-21T07:33:33.933322+0000","last_fullsized":"2024-09-21T07:33:33.933322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:27:53.862578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931168+0000","last_change":"2024-09-21T07:32:53.332543+0000","last_active":"2024-09-21T07:33:33.931168+0000","last_peered":"2024-09-21T07:33:33.931168+0000","last_clean":"2024-09-21T07:33:33.931168+0000","last_became_active":"2024-09-21T07:32:53.332174+0000","last_became_peered":"2024-09-21T07:32:53.332174+0000","last_unstale":"2024-09-21T07:33:33.931168+0000","last_undegraded":"2024-09-21T07:33:33.931168+0000","last_fullsized":"2024-09-21T07:33:33.931168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:07.268377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929424+0000","last_change":"2024-09-21T07:32:53.334231+0000","last_active":"2024-09-21T07:33:33.929424+0000","last_peered":"2024-09-21T07:33:33.929424+0000","last_clean":"2024-09-21T07:33:33.929424+0000","last_became_active":"2024-09-21T07:32:53.333838+0000","last_became_peered":"2024-09-21T07:32:53.333838+0000","last_unstale":"2024-09-21T07:33:33.929424+0000","last_undegraded":"2024-09-21T07:33:33.929424+0000","last_fullsized":"2024-09-21T07:33:33.929424+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:21.772942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962863+0000","last_change":"2024-09-21T07:32:53.328673+0000","last_active":"2024-09-21T07:33:33.962863+0000","last_peered":"2024-09-21T07:33:33.962863+0000","last_clean":"2024-09-21T07:33:33.962863+0000","last_became_active":"2024-09-21T07:32:53.328355+0000","last_became_peered":"2024-09-21T07:32:53.328355+0000","last_unstale":"2024-09-21T07:33:33.962863+0000","last_undegraded":"2024-09-21T07:33:33.962863+0000","last_fullsized":"2024-09-21T07:33:33.962863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:35.337114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934362+0000","last_change":"2024-09-21T07:32:53.332000+0000","last_active":"2024-09-21T07:33:33.934362+0000","last_peered":"2024-09-21T07:33:33.934362+0000","last_clean":"2024-09-21T07:33:33.934362+0000","last_became_active":"2024-09-21T07:32:53.331304+0000","last_became_peered":"2024-09-21T07:32:53.331304+0000","last_unstale":"2024-09-21T07:33:33.934362+0000","last_undegraded":"2024-09-21T07:33:33.934362+0000","last_fullsized":"2024-09-21T07:33:33.934362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:22.911531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934105+0000","last_change":"2024-09-21T07:32:53.334403+0000","last_active":"2024-09-21T07:33:33.934105+0000","last_peered":"2024-09-21T07:33:33.934105+0000","last_clean":"2024-09-21T07:33:33.934105+0000","last_became_active":"2024-09-21T07:32:53.333927+0000","last_became_peered":"2024-09-21T07:32:53.333927+0000","last_unstale":"2024-09-21T07:33:33.934105+0000","last_undegraded":"2024-09-21T07:33:33.934105+0000","last_fullsized":"2024-09-21T07:33:33.934105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:12.312055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935704+0000","last_change":"2024-09-21T07:32:53.335374+0000","last_active":"2024-09-21T07:33:33.935704+0000","last_peered":"2024-09-21T07:33:33.935704+0000","last_clean":"2024-09-21T07:33:33.935704+0000","last_became_active":"2024-09-21T07:32:53.334880+0000","last_became_peered":"2024-09-21T07:32:53.334880+0000","last_unstale":"2024-09-21T07:33:33.935704+0000","last_undegraded":"2024-09-21T07:33:33.935704+0000","last_fullsized":"2024-09-21T07:33:33.935704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:37.743094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931685+0000","last_change":"2024-09-21T07:32:53.333244+0000","last_active":"2024-09-21T07:33:33.931685+0000","last_peered":"2024-09-21T07:33:33.931685+0000","last_clean":"2024-09-21T07:33:33.931685+0000","last_became_active":"2024-09-21T07:32:53.332067+0000","last_became_peered":"2024-09-21T07:32:53.332067+0000","last_unstale":"2024-09-21T07:33:33.931685+0000","last_undegraded":"2024-09-21T07:33:33.931685+0000","last_fullsized":"2024-09-21T07:33:33.931685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:11.810328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929840+0000","last_change":"2024-09-21T07:32:53.329304+0000","last_active":"2024-09-21T07:33:33.929840+0000","last_peered":"2024-09-21T07:33:33.929840+0000","last_clean":"2024-09-21T07:33:33.929840+0000","last_became_active":"2024-09-21T07:32:53.328921+0000","last_became_peered":"2024-09-21T07:32:53.328921+0000","last_unstale":"2024-09-21T07:33:33.929840+0000","last_undegraded":"2024-09-21T07:33:33.929840+0000","last_fullsized":"2024-09-21T07:33:33.929840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:16.099387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936994+0000","last_change":"2024-09-21T07:32:53.324658+0000","last_active":"2024-09-21T07:33:33.936994+0000","last_peered":"2024-09-21T07:33:33.936994+0000","last_clean":"2024-09-21T07:33:33.936994+0000","last_became_active":"2024-09-21T07:32:53.323584+0000","last_became_peered":"2024-09-21T07:32:53.323584+0000","last_unstale":"2024-09-21T07:33:33.936994+0000","last_undegraded":"2024-09-21T07:33:33.936994+0000","last_fullsized":"2024-09-21T07:33:33.936994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:26:10.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934689+0000","last_change":"2024-09-21T07:33:33.934582+0000","last_active":"2024-09-21T07:33:33.934689+0000","last_peered":"2024-09-21T07:33:33.934689+0000","last_clean":"2024-09-21T07:33:33.934689+0000","last_became_active":"2024-09-21T07:33:33.934167+0000","last_became_peered":"2024-09-21T07:33:33.934167+0000","last_unstale":"2024-09-21T07:33:33.934689+0000","last_undegraded":"2024-09-21T07:33:33.934689+0000","last_fullsized":"2024-09-21T07:33:33.934689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:22:18.926204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962905+0000","last_change":"2024-09-21T07:32:53.321185+0000","last_active":"2024-09-21T07:33:33.962905+0000","last_peered":"2024-09-21T07:33:33.962905+0000","last_clean":"2024-09-21T07:33:33.962905+0000","last_became_active":"2024-09-21T07:32:53.320799+0000","last_became_peered":"2024-09-21T07:32:53.320799+0000","last_unstale":"2024-09-21T07:33:33.962905+0000","last_undegraded":"2024-09-21T07:33:33.962905+0000","last_fullsized":"2024-09-21T07:33:33.962905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:45.289546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936340+0000","last_change":"2024-09-21T07:32:53.336314+0000","last_active":"2024-09-21T07:33:33.936340+0000","last_peered":"2024-09-21T07:33:33.936340+0000","last_clean":"2024-09-21T07:33:33.936340+0000","last_became_active":"2024-09-21T07:32:53.335817+0000","last_became_peered":"2024-09-21T07:32:53.335817+0000","last_unstale":"2024-09-21T07:33:33.936340+0000","last_undegraded":"2024-09-21T07:33:33.936340+0000","last_fullsized":"2024-09-21T07:33:33.936340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:48:02.707523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.927942+0000","last_change":"2024-09-21T07:32:53.326396+0000","last_active":"2024-09-21T07:33:33.927942+0000","last_peered":"2024-09-21T07:33:33.927942+0000","last_clean":"2024-09-21T07:33:33.927942+0000","last_became_active":"2024-09-21T07:32:53.325243+0000","last_became_peered":"2024-09-21T07:32:53.325243+0000","last_unstale":"2024-09-21T07:33:33.927942+0000","last_undegraded":"2024-09-21T07:33:33.927942+0000","last_fullsized":"2024-09-21T07:33:33.927942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:42.208673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935186+0000","last_change":"2024-09-21T07:32:53.339639+0000","last_active":"2024-09-21T07:33:33.935186+0000","last_peered":"2024-09-21T07:33:33.935186+0000","last_clean":"2024-09-21T07:33:33.935186+0000","last_became_active":"2024-09-21T07:32:53.337665+0000","last_became_peered":"2024-09-21T07:32:53.337665+0000","last_unstale":"2024-09-21T07:33:33.935186+0000","last_undegraded":"2024-09-21T07:33:33.935186+0000","last_fullsized":"2024-09-21T07:33:33.935186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:58.607287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928391+0000","last_change":"2024-09-21T07:32:53.334640+0000","last_active":"2024-09-21T07:33:33.928391+0000","last_peered":"2024-09-21T07:33:33.928391+0000","last_clean":"2024-09-21T07:33:33.928391+0000","last_became_active":"2024-09-21T07:32:53.333887+0000","last_became_peered":"2024-09-21T07:32:53.333887+0000","last_unstale":"2024-09-21T07:33:33.928391+0000","last_undegraded":"2024-09-21T07:33:33.928391+0000","last_fullsized":"2024-09-21T07:33:33.928391+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:33.577056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937263+0000","last_change":"2024-09-21T07:32:53.329008+0000","last_active":"2024-09-21T07:33:33.937263+0000","last_peered":"2024-09-21T07:33:33.937263+0000","last_clean":"2024-09-21T07:33:33.937263+0000","last_became_active":"2024-09-21T07:32:53.328583+0000","last_became_peered":"2024-09-21T07:32:53.328583+0000","last_unstale":"2024-09-21T07:33:33.937263+0000","last_undegraded":"2024-09-21T07:33:33.937263+0000","last_fullsized":"2024-09-21T07:33:33.937263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:19.879625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932709+0000","last_change":"2024-09-21T07:32:53.330897+0000","last_active":"2024-09-21T07:33:33.932709+0000","last_peered":"2024-09-21T07:33:33.932709+0000","last_clean":"2024-09-21T07:33:33.932709+0000","last_became_active":"2024-09-21T07:32:53.330472+0000","last_became_peered":"2024-09-21T07:32:53.330472+0000","last_unstale":"2024-09-21T07:33:33.932709+0000","last_undegraded":"2024-09-21T07:33:33.932709+0000","last_fullsized":"2024-09-21T07:33:33.932709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:03.845202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962754+0000","last_change":"2024-09-21T07:32:53.331457+0000","last_active":"2024-09-21T07:33:33.962754+0000","last_peered":"2024-09-21T07:33:33.962754+0000","last_clean":"2024-09-21T07:33:33.962754+0000","last_became_active":"2024-09-21T07:32:53.330551+0000","last_became_peered":"2024-09-21T07:32:53.330551+0000","last_unstale":"2024-09-21T07:33:33.962754+0000","last_undegraded":"2024-09-21T07:33:33.962754+0000","last_fullsized":"2024-09-21T07:33:33.962754+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:36.419521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934524+0000","last_change":"2024-09-21T07:32:53.334139+0000","last_active":"2024-09-21T07:33:33.934524+0000","last_peered":"2024-09-21T07:33:33.934524+0000","last_clean":"2024-09-21T07:33:33.934524+0000","last_became_active":"2024-09-21T07:32:53.333778+0000","last_became_peered":"2024-09-21T07:32:53.333778+0000","last_unstale":"2024-09-21T07:33:33.934524+0000","last_undegraded":"2024-09-21T07:33:33.934524+0000","last_fullsized":"2024-09-21T07:33:33.934524+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:23.964718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936382+0000","last_change":"2024-09-21T07:32:53.328320+0000","last_active":"2024-09-21T07:33:33.936382+0000","last_peered":"2024-09-21T07:33:33.936382+0000","last_clean":"2024-09-21T07:33:33.936382+0000","last_became_active":"2024-09-21T07:32:53.327262+0000","last_became_peered":"2024-09-21T07:32:53.327262+0000","last_unstale":"2024-09-21T07:33:33.936382+0000","last_undegraded":"2024-09-21T07:33:33.936382+0000","last_fullsized":"2024-09-21T07:33:33.936382+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:43.096962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936207+0000","last_change":"2024-09-21T07:32:53.333008+0000","last_active":"2024-09-21T07:33:33.936207+0000","last_peered":"2024-09-21T07:33:33.936207+0000","last_clean":"2024-09-21T07:33:33.936207+0000","last_became_active":"2024-09-21T07:32:53.332647+0000","last_became_peered":"2024-09-21T07:32:53.332647+0000","last_unstale":"2024-09-21T07:33:33.936207+0000","last_undegraded":"2024-09-21T07:33:33.936207+0000","last_fullsized":"2024-09-21T07:33:33.936207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:29.678179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932394+0000","last_change":"2024-09-21T07:32:53.337814+0000","last_active":"2024-09-21T07:33:33.932394+0000","last_peered":"2024-09-21T07:33:33.932394+0000","last_clean":"2024-09-21T07:33:33.932394+0000","last_became_active":"2024-09-21T07:32:53.337401+0000","last_became_peered":"2024-09-21T07:32:53.337401+0000","last_unstale":"2024-09-21T07:33:33.932394+0000","last_undegraded":"2024-09-21T07:33:33.932394+0000","last_fullsized":"2024-09-21T07:33:33.932394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:33.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929443+0000","last_change":"2024-09-21T07:32:53.329954+0000","last_active":"2024-09-21T07:33:33.929443+0000","last_peered":"2024-09-21T07:33:33.929443+0000","last_clean":"2024-09-21T07:33:33.929443+0000","last_became_active":"2024-09-21T07:32:53.329593+0000","last_became_peered":"2024-09-21T07:32:53.329593+0000","last_unstale":"2024-09-21T07:33:33.929443+0000","last_undegraded":"2024-09-21T07:33:33.929443+0000","last_fullsized":"2024-09-21T07:33:33.929443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:12.032893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'5","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:56.973767+0000","last_change":"2024-09-21T07:33:33.942649+0000","last_active":"2024-09-21T07:33:56.973767+0000","last_peered":"2024-09-21T07:33:56.973767+0000","last_clean":"2024-09-21T07:33:56.973767+0000","last_became_active":"2024-09-21T07:33:33.937331+0000","last_became_peered":"2024-09-21T07:33:33.937331+0000","last_unstale":"2024-09-21T07:33:56.973767+0000","last_undegraded":"2024-09-21T07:33:56.973767+0000","last_fullsized":"2024-09-21T07:33:56.973767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:29.609077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934858+0000","last_change":"2024-09-21T07:32:53.340005+0000","last_active":"2024-09-21T07:33:33.934858+0000","last_peered":"2024-09-21T07:33:33.934858+0000","last_clean":"2024-09-21T07:33:33.934858+0000","last_became_active":"2024-09-21T07:32:53.339433+0000","last_became_peered":"2024-09-21T07:32:53.339433+0000","last_unstale":"2024-09-21T07:33:33.934858+0000","last_undegraded":"2024-09-21T07:33:33.934858+0000","last_fullsized":"2024-09-21T07:33:33.934858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:16.469652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932830+0000","last_change":"2024-09-21T07:32:51.320218+0000","last_active":"2024-09-21T07:33:33.932830+0000","last_peered":"2024-09-21T07:33:33.932830+0000","last_clean":"2024-09-21T07:33:33.932830+0000","last_became_active":"2024-09-21T07:32:51.319793+0000","last_became_peered":"2024-09-21T07:32:51.319793+0000","last_unstale":"2024-09-21T07:33:33.932830+0000","last_undegraded":"2024-09-21T07:33:33.932830+0000","last_fullsized":"2024-09-21T07:33:33.932830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.839505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962512+0000","last_change":"2024-09-21T07:32:51.313478+0000","last_active":"2024-09-21T07:33:33.962512+0000","last_peered":"2024-09-21T07:33:33.962512+0000","last_clean":"2024-09-21T07:33:33.962512+0000","last_became_active":"2024-09-21T07:32:51.313112+0000","last_became_peered":"2024-09-21T07:32:51.313112+0000","last_unstale":"2024-09-21T07:33:33.962512+0000","last_undegraded":"2024-09-21T07:33:33.962512+0000","last_fullsized":"2024-09-21T07:33:33.962512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:06:35.064888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.927961+0000","last_change":"2024-09-21T07:32:53.322252+0000","last_active":"2024-09-21T07:33:33.927961+0000","last_peered":"2024-09-21T07:33:33.927961+0000","last_clean":"2024-09-21T07:33:33.927961+0000","last_became_active":"2024-09-21T07:32:53.321919+0000","last_became_peered":"2024-09-21T07:32:53.321919+0000","last_unstale":"2024-09-21T07:33:33.927961+0000","last_undegraded":"2024-09-21T07:33:33.927961+0000","last_fullsized":"2024-09-21T07:33:33.927961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:15.852678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935562+0000","last_change":"2024-09-21T07:32:51.322190+0000","last_active":"2024-09-21T07:33:33.935562+0000","last_peered":"2024-09-21T07:33:33.935562+0000","last_clean":"2024-09-21T07:33:33.935562+0000","last_became_active":"2024-09-21T07:32:51.321307+0000","last_became_peered":"2024-09-21T07:32:51.321307+0000","last_unstale":"2024-09-21T07:33:33.935562+0000","last_undegraded":"2024-09-21T07:33:33.935562+0000","last_fullsized":"2024-09-21T07:33:33.935562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:23.029068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929552+0000","last_change":"2024-09-21T07:32:53.323650+0000","last_active":"2024-09-21T07:33:33.929552+0000","last_peered":"2024-09-21T07:33:33.929552+0000","last_clean":"2024-09-21T07:33:33.929552+0000","last_became_active":"2024-09-21T07:32:53.323304+0000","last_became_peered":"2024-09-21T07:32:53.323304+0000","last_unstale":"2024-09-21T07:33:33.929552+0000","last_undegraded":"2024-09-21T07:33:33.929552+0000","last_fullsized":"2024-09-21T07:33:33.929552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.229852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:54.970112+0000","last_change":"2024-09-21T07:32:51.319021+0000","last_active":"2024-09-21T07:33:54.970112+0000","last_peered":"2024-09-21T07:33:54.970112+0000","last_clean":"2024-09-21T07:33:54.970112+0000","last_became_active":"2024-09-21T07:32:51.318150+0000","last_became_peered":"2024-09-21T07:32:51.318150+0000","last_unstale":"2024-09-21T07:33:54.970112+0000","last_undegraded":"2024-09-21T07:33:54.970112+0000","last_fullsized":"2024-09-21T07:33:54.970112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.408401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936806+0000","last_change":"2024-09-21T07:32:53.327203+0000","last_active":"2024-09-21T07:33:33.936806+0000","last_peered":"2024-09-21T07:33:33.936806+0000","last_clean":"2024-09-21T07:33:33.936806+0000","last_became_active":"2024-09-21T07:32:53.326784+0000","last_became_peered":"2024-09-21T07:32:53.326784+0000","last_unstale":"2024-09-21T07:33:33.936806+0000","last_undegraded":"2024-09-21T07:33:33.936806+0000","last_fullsized":"2024-09-21T07:33:33.936806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:20.468948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931305+0000","last_change":"2024-09-21T07:32:51.314749+0000","last_active":"2024-09-21T07:33:33.931305+0000","last_peered":"2024-09-21T07:33:33.931305+0000","last_clean":"2024-09-21T07:33:33.931305+0000","last_became_active":"2024-09-21T07:32:51.314181+0000","last_became_peered":"2024-09-21T07:32:51.314181+0000","last_unstale":"2024-09-21T07:33:33.931305+0000","last_undegraded":"2024-09-21T07:33:33.931305+0000","last_fullsized":"2024-09-21T07:33:33.931305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:22.541053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934625+0000","last_change":"2024-09-21T07:32:53.334410+0000","last_active":"2024-09-21T07:33:33.934625+0000","last_peered":"2024-09-21T07:33:33.934625+0000","last_clean":"2024-09-21T07:33:33.934625+0000","last_became_active":"2024-09-21T07:32:53.334000+0000","last_became_peered":"2024-09-21T07:32:53.334000+0000","last_unstale":"2024-09-21T07:33:33.934625+0000","last_undegraded":"2024-09-21T07:33:33.934625+0000","last_fullsized":"2024-09-21T07:33:33.934625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:11.316706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935796+0000","last_change":"2024-09-21T07:32:51.959823+0000","last_active":"2024-09-21T07:33:33.935796+0000","last_peered":"2024-09-21T07:33:33.935796+0000","last_clean":"2024-09-21T07:33:33.935796+0000","last_became_active":"2024-09-21T07:32:51.959435+0000","last_became_peered":"2024-09-21T07:32:51.959435+0000","last_unstale":"2024-09-21T07:33:33.935796+0000","last_undegraded":"2024-09-21T07:33:33.935796+0000","last_fullsized":"2024-09-21T07:33:33.935796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:34:46.394422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936310+0000","last_change":"2024-09-21T07:32:53.334201+0000","last_active":"2024-09-21T07:33:33.936310+0000","last_peered":"2024-09-21T07:33:33.936310+0000","last_clean":"2024-09-21T07:33:33.936310+0000","last_became_active":"2024-09-21T07:32:53.333815+0000","last_became_peered":"2024-09-21T07:32:53.333815+0000","last_unstale":"2024-09-21T07:33:33.936310+0000","last_undegraded":"2024-09-21T07:33:33.936310+0000","last_fullsized":"2024-09-21T07:33:33.936310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:48.783373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'27","reported_seq":183,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:55.971498+0000","last_change":"2024-09-21T07:33:33.948762+0000","last_active":"2024-09-21T07:33:55.971498+0000","last_peered":"2024-09-21T07:33:55.971498+0000","last_clean":"2024-09-21T07:33:55.971498+0000","last_became_active":"2024-09-21T07:33:33.936931+0000","last_became_peered":"2024-09-21T07:33:33.936931+0000","last_unstale":"2024-09-21T07:33:55.971498+0000","last_undegraded":"2024-09-21T07:33:55.971498+0000","last_fullsized":"2024-09-21T07:33:55.971498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:14.292835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":117,"num_write":28,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":63902,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930070+0000","last_change":"2024-09-21T07:32:53.326999+0000","last_active":"2024-09-21T07:33:33.930070+0000","last_peered":"2024-09-21T07:33:33.930070+0000","last_clean":"2024-09-21T07:33:33.930070+0000","last_became_active":"2024-09-21T07:32:53.326550+0000","last_became_peered":"2024-09-21T07:32:53.326550+0000","last_unstale":"2024-09-21T07:33:33.930070+0000","last_undegraded":"2024-09-21T07:33:33.930070+0000","last_fullsized":"2024-09-21T07:33:33.930070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:12.036977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935744+0000","last_change":"2024-09-21T07:32:51.317687+0000","last_active":"2024-09-21T07:33:33.935744+0000","last_peered":"2024-09-21T07:33:33.935744+0000","last_clean":"2024-09-21T07:33:33.935744+0000","last_became_active":"2024-09-21T07:32:51.316986+0000","last_became_peered":"2024-09-21T07:32:51.316986+0000","last_unstale":"2024-09-21T07:33:33.935744+0000","last_undegraded":"2024-09-21T07:33:33.935744+0000","last_fullsized":"2024-09-21T07:33:33.935744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:47:39.773244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962558+0000","last_change":"2024-09-21T07:32:53.323562+0000","last_active":"2024-09-21T07:33:33.962558+0000","last_peered":"2024-09-21T07:33:33.962558+0000","last_clean":"2024-09-21T07:33:33.962558+0000","last_became_active":"2024-09-21T07:32:53.323106+0000","last_became_peered":"2024-09-21T07:32:53.323106+0000","last_unstale":"2024-09-21T07:33:33.962558+0000","last_undegraded":"2024-09-21T07:33:33.962558+0000","last_fullsized":"2024-09-21T07:33:33.962558+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:24.607014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934561+0000","last_change":"2024-09-21T07:32:51.320887+0000","last_active":"2024-09-21T07:33:33.934561+0000","last_peered":"2024-09-21T07:33:33.934561+0000","last_clean":"2024-09-21T07:33:33.934561+0000","last_became_active":"2024-09-21T07:32:51.319706+0000","last_became_peered":"2024-09-21T07:32:51.319706+0000","last_unstale":"2024-09-21T07:33:33.934561+0000","last_undegraded":"2024-09-21T07:33:33.934561+0000","last_fullsized":"2024-09-21T07:33:33.934561+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:49.594900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.963836+0000","last_change":"2024-09-21T07:33:33.963764+0000","last_active":"2024-09-21T07:33:33.963836+0000","last_peered":"2024-09-21T07:33:33.963836+0000","last_clean":"2024-09-21T07:33:33.963836+0000","last_became_active":"2024-09-21T07:33:33.963393+0000","last_became_peered":"2024-09-21T07:33:33.963393+0000","last_unstale":"2024-09-21T07:33:33.963836+0000","last_undegraded":"2024-09-21T07:33:33.963836+0000","last_fullsized":"2024-09-21T07:33:33.963836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:06:16.691302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":84,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:55.477703+0000","last_change":"2024-09-21T07:32:51.319604+0000","last_active":"2024-09-21T07:33:55.477703+0000","last_peered":"2024-09-21T07:33:55.477703+0000","last_clean":"2024-09-21T07:33:55.477703+0000","last_became_active":"2024-09-21T07:32:51.319226+0000","last_became_peered":"2024-09-21T07:32:51.319226+0000","last_unstale":"2024-09-21T07:33:55.477703+0000","last_undegraded":"2024-09-21T07:33:55.477703+0000","last_fullsized":"2024-09-21T07:33:55.477703+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:21.724229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930887+0000","last_change":"2024-09-21T07:32:53.332607+0000","last_active":"2024-09-21T07:33:33.930887+0000","last_peered":"2024-09-21T07:33:33.930887+0000","last_clean":"2024-09-21T07:33:33.930887+0000","last_became_active":"2024-09-21T07:32:53.332272+0000","last_became_peered":"2024-09-21T07:32:53.332272+0000","last_unstale":"2024-09-21T07:33:33.930887+0000","last_undegraded":"2024-09-21T07:33:33.930887+0000","last_fullsized":"2024-09-21T07:33:33.930887+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:57.193207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.953877+0000","last_change":"2024-09-21T07:33:33.953779+0000","last_active":"2024-09-21T07:33:33.953877+0000","last_peered":"2024-09-21T07:33:33.953877+0000","last_clean":"2024-09-21T07:33:33.953877+0000","last_became_active":"2024-09-21T07:33:33.939419+0000","last_became_peered":"2024-09-21T07:33:33.939419+0000","last_unstale":"2024-09-21T07:33:33.953877+0000","last_undegraded":"2024-09-21T07:33:33.953877+0000","last_fullsized":"2024-09-21T07:33:33.953877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.549286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934237+0000","last_change":"2024-09-21T07:32:53.340603+0000","last_active":"2024-09-21T07:33:33.934237+0000","last_peered":"2024-09-21T07:33:33.934237+0000","last_clean":"2024-09-21T07:33:33.934237+0000","last_became_active":"2024-09-21T07:32:53.339451+0000","last_became_peered":"2024-09-21T07:32:53.339451+0000","last_unstale":"2024-09-21T07:33:33.934237+0000","last_undegraded":"2024-09-21T07:33:33.934237+0000","last_fullsized":"2024-09-21T07:33:33.934237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:56:50.895945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929766+0000","last_change":"2024-09-21T07:32:51.321912+0000","last_active":"2024-09-21T07:33:33.929766+0000","last_peered":"2024-09-21T07:33:33.929766+0000","last_clean":"2024-09-21T07:33:33.929766+0000","last_became_active":"2024-09-21T07:32:51.320880+0000","last_became_peered":"2024-09-21T07:32:51.320880+0000","last_unstale":"2024-09-21T07:33:33.929766+0000","last_undegraded":"2024-09-21T07:33:33.929766+0000","last_fullsized":"2024-09-21T07:33:33.929766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:05.538597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931507+0000","last_change":"2024-09-21T07:32:53.332894+0000","last_active":"2024-09-21T07:33:33.931507+0000","last_peered":"2024-09-21T07:33:33.931507+0000","last_clean":"2024-09-21T07:33:33.931507+0000","last_became_active":"2024-09-21T07:32:53.332489+0000","last_became_peered":"2024-09-21T07:32:53.332489+0000","last_unstale":"2024-09-21T07:33:33.931507+0000","last_undegraded":"2024-09-21T07:33:33.931507+0000","last_fullsized":"2024-09-21T07:33:33.931507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:18.312560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962818+0000","last_change":"2024-09-21T07:32:51.313363+0000","last_active":"2024-09-21T07:33:33.962818+0000","last_peered":"2024-09-21T07:33:33.962818+0000","last_clean":"2024-09-21T07:33:33.962818+0000","last_became_active":"2024-09-21T07:32:51.313001+0000","last_became_peered":"2024-09-21T07:32:51.313001+0000","last_unstale":"2024-09-21T07:33:33.962818+0000","last_undegraded":"2024-09-21T07:33:33.962818+0000","last_fullsized":"2024-09-21T07:33:33.962818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:58.056561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931933+0000","last_change":"2024-09-21T07:32:53.325791+0000","last_active":"2024-09-21T07:33:33.931933+0000","last_peered":"2024-09-21T07:33:33.931933+0000","last_clean":"2024-09-21T07:33:33.931933+0000","last_became_active":"2024-09-21T07:32:53.325406+0000","last_became_peered":"2024-09-21T07:32:53.325406+0000","last_unstale":"2024-09-21T07:33:33.931933+0000","last_undegraded":"2024-09-21T07:33:33.931933+0000","last_fullsized":"2024-09-21T07:33:33.931933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:32.915438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935678+0000","last_change":"2024-09-21T07:32:51.318862+0000","last_active":"2024-09-21T07:33:33.935678+0000","last_peered":"2024-09-21T07:33:33.935678+0000","last_clean":"2024-09-21T07:33:33.935678+0000","last_became_active":"2024-09-21T07:32:51.318423+0000","last_became_peered":"2024-09-21T07:32:51.318423+0000","last_unstale":"2024-09-21T07:33:33.935678+0000","last_undegraded":"2024-09-21T07:33:33.935678+0000","last_fullsized":"2024-09-21T07:33:33.935678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:21:57.438214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931111+0000","last_change":"2024-09-21T07:32:53.333475+0000","last_active":"2024-09-21T07:33:33.931111+0000","last_peered":"2024-09-21T07:33:33.931111+0000","last_clean":"2024-09-21T07:33:33.931111+0000","last_became_active":"2024-09-21T07:32:53.333039+0000","last_became_peered":"2024-09-21T07:32:53.333039+0000","last_unstale":"2024-09-21T07:33:33.931111+0000","last_undegraded":"2024-09-21T07:33:33.931111+0000","last_fullsized":"2024-09-21T07:33:33.931111+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:39.510813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.937280+0000","last_change":"2024-09-21T07:32:51.958898+0000","last_active":"2024-09-21T07:33:33.937280+0000","last_peered":"2024-09-21T07:33:33.937280+0000","last_clean":"2024-09-21T07:33:33.937280+0000","last_became_active":"2024-09-21T07:32:51.958411+0000","last_became_peered":"2024-09-21T07:32:51.958411+0000","last_unstale":"2024-09-21T07:33:33.937280+0000","last_undegraded":"2024-09-21T07:33:33.937280+0000","last_fullsized":"2024-09-21T07:33:33.937280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:12.375874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931235+0000","last_change":"2024-09-21T07:32:53.331327+0000","last_active":"2024-09-21T07:33:33.931235+0000","last_peered":"2024-09-21T07:33:33.931235+0000","last_clean":"2024-09-21T07:33:33.931235+0000","last_became_active":"2024-09-21T07:32:53.329449+0000","last_became_peered":"2024-09-21T07:32:53.329449+0000","last_unstale":"2024-09-21T07:33:33.931235+0000","last_undegraded":"2024-09-21T07:33:33.931235+0000","last_fullsized":"2024-09-21T07:33:33.931235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:20.605458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931646+0000","last_change":"2024-09-21T07:31:42.854046+0000","last_active":"2024-09-21T07:33:33.931646+0000","last_peered":"2024-09-21T07:33:33.931646+0000","last_clean":"2024-09-21T07:33:33.931646+0000","last_became_active":"2024-09-21T07:31:42.847659+0000","last_became_peered":"2024-09-21T07:31:42.847659+0000","last_unstale":"2024-09-21T07:33:33.931646+0000","last_undegraded":"2024-09-21T07:33:33.931646+0000","last_fullsized":"2024-09-21T07:33:33.931646+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:28:23.379848+0000","last_clean_scrub_stamp":"2024-09-21T07:28:23.379848+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:17.782511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929108+0000","last_change":"2024-09-21T07:32:51.316842+0000","last_active":"2024-09-21T07:33:33.929108+0000","last_peered":"2024-09-21T07:33:33.929108+0000","last_clean":"2024-09-21T07:33:33.929108+0000","last_became_active":"2024-09-21T07:32:51.316409+0000","last_became_peered":"2024-09-21T07:32:51.316409+0000","last_unstale":"2024-09-21T07:33:33.929108+0000","last_undegraded":"2024-09-21T07:33:33.929108+0000","last_fullsized":"2024-09-21T07:33:33.929108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.648952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928056+0000","last_change":"2024-09-21T07:32:53.331632+0000","last_active":"2024-09-21T07:33:33.928056+0000","last_peered":"2024-09-21T07:33:33.928056+0000","last_clean":"2024-09-21T07:33:33.928056+0000","last_became_active":"2024-09-21T07:32:53.331071+0000","last_became_peered":"2024-09-21T07:32:53.331071+0000","last_unstale":"2024-09-21T07:33:33.928056+0000","last_undegraded":"2024-09-21T07:33:33.928056+0000","last_fullsized":"2024-09-21T07:33:33.928056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:41.568187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931505+0000","last_change":"2024-09-21T07:32:51.319580+0000","last_active":"2024-09-21T07:33:33.931505+0000","last_peered":"2024-09-21T07:33:33.931505+0000","last_clean":"2024-09-21T07:33:33.931505+0000","last_became_active":"2024-09-21T07:32:51.319199+0000","last_became_peered":"2024-09-21T07:32:51.319199+0000","last_unstale":"2024-09-21T07:33:33.931505+0000","last_undegraded":"2024-09-21T07:33:33.931505+0000","last_fullsized":"2024-09-21T07:33:33.931505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:39.851480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962507+0000","last_change":"2024-09-21T07:32:53.330969+0000","last_active":"2024-09-21T07:33:33.962507+0000","last_peered":"2024-09-21T07:33:33.962507+0000","last_clean":"2024-09-21T07:33:33.962507+0000","last_became_active":"2024-09-21T07:32:53.329772+0000","last_became_peered":"2024-09-21T07:32:53.329772+0000","last_unstale":"2024-09-21T07:33:33.962507+0000","last_undegraded":"2024-09-21T07:33:33.962507+0000","last_fullsized":"2024-09-21T07:33:33.962507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:23.790114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:55.476689+0000","last_change":"2024-09-21T07:32:51.958596+0000","last_active":"2024-09-21T07:33:55.476689+0000","last_peered":"2024-09-21T07:33:55.476689+0000","last_clean":"2024-09-21T07:33:55.476689+0000","last_became_active":"2024-09-21T07:32:51.958140+0000","last_became_peered":"2024-09-21T07:32:51.958140+0000","last_unstale":"2024-09-21T07:33:55.476689+0000","last_undegraded":"2024-09-21T07:33:55.476689+0000","last_fullsized":"2024-09-21T07:33:55.476689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:43.697003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935319+0000","last_change":"2024-09-21T07:32:53.340627+0000","last_active":"2024-09-21T07:33:33.935319+0000","last_peered":"2024-09-21T07:33:33.935319+0000","last_clean":"2024-09-21T07:33:33.935319+0000","last_became_active":"2024-09-21T07:32:53.340095+0000","last_became_peered":"2024-09-21T07:32:53.340095+0000","last_unstale":"2024-09-21T07:33:33.935319+0000","last_undegraded":"2024-09-21T07:33:33.935319+0000","last_fullsized":"2024-09-21T07:33:33.935319+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:55.053809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931356+0000","last_change":"2024-09-21T07:32:51.316441+0000","last_active":"2024-09-21T07:33:33.931356+0000","last_peered":"2024-09-21T07:33:33.931356+0000","last_clean":"2024-09-21T07:33:33.931356+0000","last_became_active":"2024-09-21T07:32:51.315920+0000","last_became_peered":"2024-09-21T07:32:51.315920+0000","last_unstale":"2024-09-21T07:33:33.931356+0000","last_undegraded":"2024-09-21T07:33:33.931356+0000","last_fullsized":"2024-09-21T07:33:33.931356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:14:06.459155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.933378+0000","last_change":"2024-09-21T07:32:53.338859+0000","last_active":"2024-09-21T07:33:33.933378+0000","last_peered":"2024-09-21T07:33:33.933378+0000","last_clean":"2024-09-21T07:33:33.933378+0000","last_became_active":"2024-09-21T07:32:53.338332+0000","last_became_peered":"2024-09-21T07:32:53.338332+0000","last_unstale":"2024-09-21T07:33:33.933378+0000","last_undegraded":"2024-09-21T07:33:33.933378+0000","last_fullsized":"2024-09-21T07:33:33.933378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:54:21.852758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929776+0000","last_change":"2024-09-21T07:32:51.959081+0000","last_active":"2024-09-21T07:33:33.929776+0000","last_peered":"2024-09-21T07:33:33.929776+0000","last_clean":"2024-09-21T07:33:33.929776+0000","last_became_active":"2024-09-21T07:32:51.958701+0000","last_became_peered":"2024-09-21T07:32:51.958701+0000","last_unstale":"2024-09-21T07:33:33.929776+0000","last_undegraded":"2024-09-21T07:33:33.929776+0000","last_fullsized":"2024-09-21T07:33:33.929776+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:07:56.216119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932974+0000","last_change":"2024-09-21T07:32:53.328300+0000","last_active":"2024-09-21T07:33:33.932974+0000","last_peered":"2024-09-21T07:33:33.932974+0000","last_clean":"2024-09-21T07:33:33.932974+0000","last_became_active":"2024-09-21T07:32:53.327485+0000","last_became_peered":"2024-09-21T07:32:53.327485+0000","last_unstale":"2024-09-21T07:33:33.932974+0000","last_undegraded":"2024-09-21T07:33:33.932974+0000","last_fullsized":"2024-09-21T07:33:33.932974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:46.958341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.941364+0000","last_change":"2024-09-21T07:33:33.941286+0000","last_active":"2024-09-21T07:33:33.941364+0000","last_peered":"2024-09-21T07:33:33.941364+0000","last_clean":"2024-09-21T07:33:33.941364+0000","last_became_active":"2024-09-21T07:33:33.936016+0000","last_became_peered":"2024-09-21T07:33:33.936016+0000","last_unstale":"2024-09-21T07:33:33.941364+0000","last_undegraded":"2024-09-21T07:33:33.941364+0000","last_fullsized":"2024-09-21T07:33:33.941364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:54.453199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.962772+0000","last_change":"2024-09-21T07:32:53.316991+0000","last_active":"2024-09-21T07:33:33.962772+0000","last_peered":"2024-09-21T07:33:33.962772+0000","last_clean":"2024-09-21T07:33:33.962772+0000","last_became_active":"2024-09-21T07:32:53.316588+0000","last_became_peered":"2024-09-21T07:32:53.316588+0000","last_unstale":"2024-09-21T07:33:33.962772+0000","last_undegraded":"2024-09-21T07:33:33.962772+0000","last_fullsized":"2024-09-21T07:33:33.962772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:04.766114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929876+0000","last_change":"2024-09-21T07:32:51.317544+0000","last_active":"2024-09-21T07:33:33.929876+0000","last_peered":"2024-09-21T07:33:33.929876+0000","last_clean":"2024-09-21T07:33:33.929876+0000","last_became_active":"2024-09-21T07:32:51.317091+0000","last_became_peered":"2024-09-21T07:32:51.317091+0000","last_unstale":"2024-09-21T07:33:33.929876+0000","last_undegraded":"2024-09-21T07:33:33.929876+0000","last_fullsized":"2024-09-21T07:33:33.929876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:25.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928395+0000","last_change":"2024-09-21T07:32:53.328118+0000","last_active":"2024-09-21T07:33:33.928395+0000","last_peered":"2024-09-21T07:33:33.928395+0000","last_clean":"2024-09-21T07:33:33.928395+0000","last_became_active":"2024-09-21T07:32:53.327755+0000","last_became_peered":"2024-09-21T07:32:53.327755+0000","last_unstale":"2024-09-21T07:33:33.928395+0000","last_undegraded":"2024-09-21T07:33:33.928395+0000","last_fullsized":"2024-09-21T07:33:33.928395+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:00.655258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929351+0000","last_change":"2024-09-21T07:32:51.566524+0000","last_active":"2024-09-21T07:33:33.929351+0000","last_peered":"2024-09-21T07:33:33.929351+0000","last_clean":"2024-09-21T07:33:33.929351+0000","last_became_active":"2024-09-21T07:32:51.566115+0000","last_became_peered":"2024-09-21T07:32:51.566115+0000","last_unstale":"2024-09-21T07:33:33.929351+0000","last_undegraded":"2024-09-21T07:33:33.929351+0000","last_fullsized":"2024-09-21T07:33:33.929351+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:01.098512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934494+0000","last_change":"2024-09-21T07:32:53.334275+0000","last_active":"2024-09-21T07:33:33.934494+0000","last_peered":"2024-09-21T07:33:33.934494+0000","last_clean":"2024-09-21T07:33:33.934494+0000","last_became_active":"2024-09-21T07:32:53.333842+0000","last_became_peered":"2024-09-21T07:32:53.333842+0000","last_unstale":"2024-09-21T07:33:33.934494+0000","last_undegraded":"2024-09-21T07:33:33.934494+0000","last_fullsized":"2024-09-21T07:33:33.934494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:21.370325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936050+0000","last_change":"2024-09-21T07:32:51.959211+0000","last_active":"2024-09-21T07:33:33.936050+0000","last_peered":"2024-09-21T07:33:33.936050+0000","last_clean":"2024-09-21T07:33:33.936050+0000","last_became_active":"2024-09-21T07:32:51.958887+0000","last_became_peered":"2024-09-21T07:32:51.958887+0000","last_unstale":"2024-09-21T07:33:33.936050+0000","last_undegraded":"2024-09-21T07:33:33.936050+0000","last_fullsized":"2024-09-21T07:33:33.936050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:22.877779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929535+0000","last_change":"2024-09-21T07:32:53.323125+0000","last_active":"2024-09-21T07:33:33.929535+0000","last_peered":"2024-09-21T07:33:33.929535+0000","last_clean":"2024-09-21T07:33:33.929535+0000","last_became_active":"2024-09-21T07:32:53.322746+0000","last_became_peered":"2024-09-21T07:32:53.322746+0000","last_unstale":"2024-09-21T07:33:33.929535+0000","last_undegraded":"2024-09-21T07:33:33.929535+0000","last_fullsized":"2024-09-21T07:33:33.929535+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:53.957518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928087+0000","last_change":"2024-09-21T07:32:51.314786+0000","last_active":"2024-09-21T07:33:33.928087+0000","last_peered":"2024-09-21T07:33:33.928087+0000","last_clean":"2024-09-21T07:33:33.928087+0000","last_became_active":"2024-09-21T07:32:51.314436+0000","last_became_peered":"2024-09-21T07:32:51.314436+0000","last_unstale":"2024-09-21T07:33:33.928087+0000","last_undegraded":"2024-09-21T07:33:33.928087+0000","last_fullsized":"2024-09-21T07:33:33.928087+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:39.672746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.932539+0000","last_change":"2024-09-21T07:32:53.332759+0000","last_active":"2024-09-21T07:33:33.932539+0000","last_peered":"2024-09-21T07:33:33.932539+0000","last_clean":"2024-09-21T07:33:33.932539+0000","last_became_active":"2024-09-21T07:32:53.332353+0000","last_became_peered":"2024-09-21T07:32:53.332353+0000","last_unstale":"2024-09-21T07:33:33.932539+0000","last_undegraded":"2024-09-21T07:33:33.932539+0000","last_fullsized":"2024-09-21T07:33:33.932539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:22.561528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936531+0000","last_change":"2024-09-21T07:32:51.318180+0000","last_active":"2024-09-21T07:33:33.936531+0000","last_peered":"2024-09-21T07:33:33.936531+0000","last_clean":"2024-09-21T07:33:33.936531+0000","last_became_active":"2024-09-21T07:32:51.317630+0000","last_became_peered":"2024-09-21T07:32:51.317630+0000","last_unstale":"2024-09-21T07:33:33.936531+0000","last_undegraded":"2024-09-21T07:33:33.936531+0000","last_fullsized":"2024-09-21T07:33:33.936531+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:48.976579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928164+0000","last_change":"2024-09-21T07:32:53.326166+0000","last_active":"2024-09-21T07:33:33.928164+0000","last_peered":"2024-09-21T07:33:33.928164+0000","last_clean":"2024-09-21T07:33:33.928164+0000","last_became_active":"2024-09-21T07:32:53.325797+0000","last_became_peered":"2024-09-21T07:32:53.325797+0000","last_unstale":"2024-09-21T07:33:33.928164+0000","last_undegraded":"2024-09-21T07:33:33.928164+0000","last_fullsized":"2024-09-21T07:33:33.928164+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:43.130088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929619+0000","last_change":"2024-09-21T07:32:51.323554+0000","last_active":"2024-09-21T07:33:33.929619+0000","last_peered":"2024-09-21T07:33:33.929619+0000","last_clean":"2024-09-21T07:33:33.929619+0000","last_became_active":"2024-09-21T07:32:51.322847+0000","last_became_peered":"2024-09-21T07:32:51.322847+0000","last_unstale":"2024-09-21T07:33:33.929619+0000","last_undegraded":"2024-09-21T07:33:33.929619+0000","last_fullsized":"2024-09-21T07:33:33.929619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:28:23.102513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.931214+0000","last_change":"2024-09-21T07:32:53.330124+0000","last_active":"2024-09-21T07:33:33.931214+0000","last_peered":"2024-09-21T07:33:33.931214+0000","last_clean":"2024-09-21T07:33:33.931214+0000","last_became_active":"2024-09-21T07:32:53.329497+0000","last_became_peered":"2024-09-21T07:32:53.329497+0000","last_unstale":"2024-09-21T07:33:33.931214+0000","last_undegraded":"2024-09-21T07:33:33.931214+0000","last_fullsized":"2024-09-21T07:33:33.931214+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:40.394319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.935351+0000","last_change":"2024-09-21T07:32:53.340492+0000","last_active":"2024-09-21T07:33:33.935351+0000","last_peered":"2024-09-21T07:33:33.935351+0000","last_clean":"2024-09-21T07:33:33.935351+0000","last_became_active":"2024-09-21T07:32:53.339535+0000","last_became_peered":"2024-09-21T07:32:53.339535+0000","last_unstale":"2024-09-21T07:33:33.935351+0000","last_undegraded":"2024-09-21T07:33:33.935351+0000","last_fullsized":"2024-09-21T07:33:33.935351+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:01.671302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929995+0000","last_change":"2024-09-21T07:32:51.321423+0000","last_active":"2024-09-21T07:33:33.929995+0000","last_peered":"2024-09-21T07:33:33.929995+0000","last_clean":"2024-09-21T07:33:33.929995+0000","last_became_active":"2024-09-21T07:32:51.320844+0000","last_became_peered":"2024-09-21T07:32:51.320844+0000","last_unstale":"2024-09-21T07:33:33.929995+0000","last_undegraded":"2024-09-21T07:33:33.929995+0000","last_fullsized":"2024-09-21T07:33:33.929995+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:29.771991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.936123+0000","last_change":"2024-09-21T07:32:53.337661+0000","last_active":"2024-09-21T07:33:33.936123+0000","last_peered":"2024-09-21T07:33:33.936123+0000","last_clean":"2024-09-21T07:33:33.936123+0000","last_became_active":"2024-09-21T07:32:53.337269+0000","last_became_peered":"2024-09-21T07:32:53.337269+0000","last_unstale":"2024-09-21T07:33:33.936123+0000","last_undegraded":"2024-09-21T07:33:33.936123+0000","last_fullsized":"2024-09-21T07:33:33.936123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:31.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.930070+0000","last_change":"2024-09-21T07:32:51.323429+0000","last_active":"2024-09-21T07:33:33.930070+0000","last_peered":"2024-09-21T07:33:33.930070+0000","last_clean":"2024-09-21T07:33:33.930070+0000","last_became_active":"2024-09-21T07:32:51.323037+0000","last_became_peered":"2024-09-21T07:32:51.323037+0000","last_unstale":"2024-09-21T07:33:33.930070+0000","last_undegraded":"2024-09-21T07:33:33.930070+0000","last_fullsized":"2024-09-21T07:33:33.930070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:38.797479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.934594+0000","last_change":"2024-09-21T07:32:53.327544+0000","last_active":"2024-09-21T07:33:33.934594+0000","last_peered":"2024-09-21T07:33:33.934594+0000","last_clean":"2024-09-21T07:33:33.934594+0000","last_became_active":"2024-09-21T07:32:53.326960+0000","last_became_peered":"2024-09-21T07:32:53.326960+0000","last_unstale":"2024-09-21T07:33:33.934594+0000","last_undegraded":"2024-09-21T07:33:33.934594+0000","last_fullsized":"2024-09-21T07:33:33.934594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:47.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928575+0000","last_change":"2024-09-21T07:32:51.959814+0000","last_active":"2024-09-21T07:33:33.928575+0000","last_peered":"2024-09-21T07:33:33.928575+0000","last_clean":"2024-09-21T07:33:33.928575+0000","last_became_active":"2024-09-21T07:32:51.957948+0000","last_became_peered":"2024-09-21T07:32:51.957948+0000","last_unstale":"2024-09-21T07:33:33.928575+0000","last_undegraded":"2024-09-21T07:33:33.928575+0000","last_fullsized":"2024-09-21T07:33:33.928575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:08:34.949022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.928388+0000","last_change":"2024-09-21T07:32:53.328689+0000","last_active":"2024-09-21T07:33:33.928388+0000","last_peered":"2024-09-21T07:33:33.928388+0000","last_clean":"2024-09-21T07:33:33.928388+0000","last_became_active":"2024-09-21T07:32:53.328340+0000","last_became_peered":"2024-09-21T07:32:53.328340+0000","last_unstale":"2024-09-21T07:33:33.928388+0000","last_undegraded":"2024-09-21T07:33:33.928388+0000","last_fullsized":"2024-09-21T07:33:33.928388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:52.304118+0000","last_clean_scrub_stamp":"2024-09-21T07:32:52.304118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:11.294632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T07:33:33.929953+0000","last_change":"2024-09-21T07:32:51.317674+0000","last_active":"2024-09-21T07:33:33.929953+0000","last_peered":"2024-09-21T07:33:33.929953+0000","last_clean":"2024-09-21T07:33:33.929953+0000","last_became_active":"2024-09-21T07:32:51.317097+0000","last_became_peered":"2024-09-21T07:32:51.317097+0000","last_unstale":"2024-09-21T07:33:33.929953+0000","last_undegraded":"2024-09-21T07:33:33.929953+0000","last_fullsized":"2024-09-21T07:33:33.929953+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:32:50.300110+0000","last_clean_scrub_stamp":"2024-09-21T07:32:50.300110+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:45:42.144187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67903,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":341,"num_read_kb":241,"num_write":160,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":64658,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":831488,"data_stored":400556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1597,"internal_metadata":31914435},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1519616,"data_stored":1056196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135907,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":400658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1601,"internal_metadata":27654591},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":823296,"data_stored":400444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495663,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712564,"statfs":{"total":95995035648,"available":95961665536,"internally_reserved":0,"allocated":1429504,"data_stored":992508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40316,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704836,"statfs":{"total":95995035648,"available":95953752064,"internally_reserved":0,"allocated":823296,"data_stored":400047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712556,"statfs":{"total":95995035648,"available":95961657344,"internally_reserved":0,"allocated":1441792,"data_stored":991801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":909312,"data_stored":465399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":400358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":831488,"data_stored":400568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607629,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":463742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":401318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:34:00.995 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:34:00.995 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:34:00.995 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:34:00.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T07:34:01.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:00 smithi187 ceph-mon[34367]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:34:01.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:00 smithi123 ceph-mon[34166]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:34:01.256 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 -- 172.21.15.60:0/4000099903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8109df0 msgr2=0x7fd8e8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/4000099903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8109df0 0x7fd8e8110620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009ca0 tx=0x7fd8e002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 -- 172.21.15.60:0/4000099903 shutdown_connections 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/4000099903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8109df0 0x7fd8e8110620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/4000099903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e81094a0 0x7fd8e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/4000099903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e8103b60 0x7fd8e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 -- 172.21.15.60:0/4000099903 >> 172.21.15.60:0/4000099903 conn(0x7fd8e807b850 msgr2=0x7fd8e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 -- 172.21.15.60:0/4000099903 shutdown_connections 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.702+0000 7fd8edd4b640 1 -- 172.21.15.60:0/4000099903 wait complete. 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 Processor -- start 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 -- start start 2024-09-21T07:34:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 0x7fd8e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e81094a0 0x7fd8e8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e8109df0 0x7fd8e8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8113ab0 con 0x7fd8e8103b60 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8113930 con 0x7fd8e8109df0 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8edd4b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e8113c30 con 0x7fd8e81094a0 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 0x7fd8e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 0x7fd8e8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39198/0 (socket says 172.21.15.60:39198) 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.703+0000 7fd8e77fe640 1 -- 172.21.15.60:0/3762005219 learned_addr learned my addr 172.21.15.60:0/3762005219 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e7fff640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e8109df0 0x7fd8e8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e6ffd640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e81094a0 0x7fd8e8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e77fe640 1 -- 172.21.15.60:0/3762005219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e81094a0 msgr2=0x7fd8e8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e77fe640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e81094a0 0x7fd8e8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e77fe640 1 -- 172.21.15.60:0/3762005219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e8109df0 msgr2=0x7fd8e8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e77fe640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e8109df0 0x7fd8e8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e77fe640 1 -- 172.21.15.60:0/3762005219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e81a8700 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e6ffd640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e81094a0 0x7fd8e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e77fe640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 0x7fd8e8075710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800d770 tx=0x7fd8d800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8017070 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d80054d0 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e81a89f0 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8004c30 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.704+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e81a8ee0 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.705+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e8103f70 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.707+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd8d8004dd0 con 0x7fd8e8103b60 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.708+0000 7fd8e4ff9640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd8d00b65a0 0x7fd8d00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.708+0000 7fd8e6ffd640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd8d00b65a0 0x7fd8d00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.708+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fd8d80e7420 con 0x7fd8e8103b60 2024-09-21T07:34:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.708+0000 7fd8e6ffd640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd8d00b65a0 0x7fd8d00b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc005d00 tx=0x7fd8dc009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.712+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8d80adb80 con 0x7fd8e8103b60 2024-09-21T07:34:01.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:01 smithi187 ceph-mon[34367]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.942+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8e802e640 con 0x7fd8e8103b60 2024-09-21T07:34:01.944 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:01 smithi060 ceph-mon[31244]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:01.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.943+0000 7fd8e4ff9640 1 -- 172.21.15.60:0/3762005219 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd8d80b1f60 con 0x7fd8e8103b60 2024-09-21T07:34:01.945 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:01.945 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:34:01.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd8d00b65a0 msgr2=0x7fd8d00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:01.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd8d00b65a0 0x7fd8d00b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc005d00 tx=0x7fd8dc009550 comp rx=0 tx=0).stop 2024-09-21T07:34:01.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 msgr2=0x7fd8e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:01.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 0x7fd8e8075710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800d770 tx=0x7fd8d800dc30 comp rx=0 tx=0).stop 2024-09-21T07:34:01.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 shutdown_connections 2024-09-21T07:34:01.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fd8d00b65a0 0x7fd8d00b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8e8109df0 0x7fd8e8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e81094a0 0x7fd8e8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 --2- 172.21.15.60:0/3762005219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e8103b60 0x7fd8e8075710 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:01.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.945+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 >> 172.21.15.60:0/3762005219 conn(0x7fd8e807b850 msgr2=0x7fd8e8105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:01.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.946+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 shutdown_connections 2024-09-21T07:34:01.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:01.946+0000 7fd8edd4b640 1 -- 172.21.15.60:0/3762005219 wait complete. 2024-09-21T07:34:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:01 smithi123 ceph-mon[34166]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:02.608 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:34:02.608 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:34:02.870 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:02.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:02 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3762005219' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:34:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:02 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3762005219' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:34:03.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:02 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3762005219' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:34:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 -- 172.21.15.60:0/3913744936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c1083a0 msgr2=0x7f654c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 --2- 172.21.15.60:0/3913744936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c1083a0 0x7f654c1087b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6534009900 tx=0x7f653402a410 comp rx=0 tx=0).stop 2024-09-21T07:34:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 -- 172.21.15.60:0/3913744936 shutdown_connections 2024-09-21T07:34:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 --2- 172.21.15.60:0/3913744936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c108cf0 0x7f654c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 --2- 172.21.15.60:0/3913744936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c1083a0 0x7f654c1087b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 --2- 172.21.15.60:0/3913744936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c102a60 0x7f654c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 -- 172.21.15.60:0/3913744936 >> 172.21.15.60:0/3913744936 conn(0x7f654c079730 msgr2=0x7f654c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 -- 172.21.15.60:0/3913744936 shutdown_connections 2024-09-21T07:34:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.320+0000 7f6552579640 1 -- 172.21.15.60:0/3913744936 wait complete. 2024-09-21T07:34:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 Processor -- start 2024-09-21T07:34:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 -- start start 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c102a60 0x7f654c10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c1083a0 0x7f654c1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 0x7f654c110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113a80 con 0x7f654c108cf0 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113900 con 0x7f654c1083a0 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6552579640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f654c113c00 con 0x7f654c102a60 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6550b16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 0x7f654c110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6550b16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 0x7f654c110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39222/0 (socket says 172.21.15.60:39222) 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6550b16640 1 -- 172.21.15.60:0/1067467889 learned_addr learned my addr 172.21.15.60:0/1067467889 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f654bfff640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c102a60 0x7f654c10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:03.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.321+0000 7f6543fff640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c1083a0 0x7f654c1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6550b16640 1 -- 172.21.15.60:0/1067467889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c102a60 msgr2=0x7f654c10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6550b16640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c102a60 0x7f654c10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6550b16640 1 -- 172.21.15.60:0/1067467889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c1083a0 msgr2=0x7f654c1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6550b16640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c1083a0 0x7f654c1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6550b16640 1 -- 172.21.15.60:0/1067467889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654c1a8850 con 0x7f654c108cf0 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6550b16640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 0x7f654c110a30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f654400eb10 tx=0x7f654400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544004b20 con 0x7f654c108cf0 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654c1a8b40 con 0x7f654c108cf0 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6544004cc0 con 0x7f654c108cf0 2024-09-21T07:34:03.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6544010670 con 0x7f654c108cf0 2024-09-21T07:34:03.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.322+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f654c1a9050 con 0x7f654c108cf0 2024-09-21T07:34:03.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.323+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f654c102e70 con 0x7f654c108cf0 2024-09-21T07:34:03.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.325+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6544005000 con 0x7f654c108cf0 2024-09-21T07:34:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.326+0000 7f6549ffb640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f65380b65a0 0x7f65380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.326+0000 7f654bfff640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f65380b65a0 0x7f65380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.326+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f65440e7be0 con 0x7f654c108cf0 2024-09-21T07:34:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.326+0000 7f654bfff640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f65380b65a0 0x7f65380b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f654c111a00 tx=0x7f653c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:03.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.329+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6544056710 con 0x7f654c108cf0 2024-09-21T07:34:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.556+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f654c1112b0 con 0x7f654c108cf0 2024-09-21T07:34:03.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.557+0000 7f6549ffb640 1 -- 172.21.15.60:0/1067467889 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f654c1112b0 con 0x7f654c108cf0 2024-09-21T07:34:03.559 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:03.559 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T07:33:05:373246+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:33:05.146717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24613,24623,24653]},"id":1}]} 2024-09-21T07:34:03.559 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f65380b65a0 msgr2=0x7f65380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f65380b65a0 0x7f65380b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f654c111a00 tx=0x7f653c005f90 comp rx=0 tx=0).stop 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 msgr2=0x7f654c110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 0x7f654c110a30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f654400eb10 tx=0x7f654400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 shutdown_connections 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f65380b65a0 0x7f65380b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f654c108cf0 0x7f654c110a30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f654c1083a0 0x7f654c1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 --2- 172.21.15.60:0/1067467889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f654c102a60 0x7f654c10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:03.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 >> 172.21.15.60:0/1067467889 conn(0x7f654c079730 msgr2=0x7f654c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:03.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 shutdown_connections 2024-09-21T07:34:03.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:03.559+0000 7f6552579640 1 -- 172.21.15.60:0/1067467889 wait complete. 2024-09-21T07:34:03.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:03 smithi060 ceph-mon[31244]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:03.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:03 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1067467889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:04.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:03 smithi187 ceph-mon[34367]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:04.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:03 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1067467889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:03 smithi123 ceph-mon[34166]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:04.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:03 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1067467889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:04.240 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:34:04.502 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:04.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.967+0000 7f268eb67640 1 -- 172.21.15.60:0/884147351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2688105300 msgr2=0x7f268810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:04.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.967+0000 7f268eb67640 1 --2- 172.21.15.60:0/884147351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2688105300 0x7f268810d850 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2678009900 tx=0x7f267802a410 comp rx=0 tx=0).stop 2024-09-21T07:34:04.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 -- 172.21.15.60:0/884147351 shutdown_connections 2024-09-21T07:34:04.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 --2- 172.21.15.60:0/884147351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f268810de10 0x7f2688110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:04.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 --2- 172.21.15.60:0/884147351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2688105300 0x7f268810d850 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:04.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 --2- 172.21.15.60:0/884147351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26881049b0 0x7f2688104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:04.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 -- 172.21.15.60:0/884147351 >> 172.21.15.60:0/884147351 conn(0x7f2688079730 msgr2=0x7f2688079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:04.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 -- 172.21.15.60:0/884147351 shutdown_connections 2024-09-21T07:34:04.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.968+0000 7f268eb67640 1 -- 172.21.15.60:0/884147351 wait complete. 2024-09-21T07:34:04.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 Processor -- start 2024-09-21T07:34:04.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 -- start start 2024-09-21T07:34:04.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 0x7f268819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:04.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2688105300 0x7f268819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f268810de10 0x7f268819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2688113ac0 con 0x7f26881049b0 2024-09-21T07:34:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2688113940 con 0x7f268810de10 2024-09-21T07:34:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268eb67640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2688113c40 con 0x7f2688105300 2024-09-21T07:34:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268c903640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 0x7f268819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268c903640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 0x7f268819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39236/0 (socket says 172.21.15.60:39236) 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268c903640 1 -- 172.21.15.60:0/127250873 learned_addr learned my addr 172.21.15.60:0/127250873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f267ffff640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2688105300 0x7f268819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.969+0000 7f268d104640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f268810de10 0x7f268819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268c903640 1 -- 172.21.15.60:0/127250873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2688105300 msgr2=0x7f268819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268c903640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2688105300 0x7f268819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268c903640 1 -- 172.21.15.60:0/127250873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f268810de10 msgr2=0x7f268819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268c903640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f268810de10 0x7f268819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268c903640 1 -- 172.21.15.60:0/127250873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26881a0420 con 0x7f26881049b0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268c903640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 0x7f268819a4b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f268400c970 tx=0x7f268400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684004220 con 0x7f26881049b0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26881a0710 con 0x7f26881049b0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26840043c0 con 0x7f26881049b0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684004a00 con 0x7f26881049b0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.970+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26881a6e70 con 0x7f26881049b0 2024-09-21T07:34:04.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.971+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2688104dc0 con 0x7f26881049b0 2024-09-21T07:34:04.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.973+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f26840079b0 con 0x7f26881049b0 2024-09-21T07:34:04.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.974+0000 7f267dffb640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f26700b65a0 0x7f26700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:04.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.974+0000 7f267ffff640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f26700b65a0 0x7f26700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:04.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.974+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f26840e7690 con 0x7f26881049b0 2024-09-21T07:34:04.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.974+0000 7f267ffff640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f26700b65a0 0x7f26700b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f267802aa00 tx=0x7f2678031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:04.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:04.977+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2684014030 con 0x7f26881049b0 2024-09-21T07:34:05.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.202+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2688108f70 con 0x7f26881049b0 2024-09-21T07:34:05.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.203+0000 7f267dffb640 1 -- 172.21.15.60:0/127250873 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f26840addf0 con 0x7f26881049b0 2024-09-21T07:34:05.204 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:05.205 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T07:33:05:373246+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:33:05.146717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24613,24623,24653]},"id":1}]} 2024-09-21T07:34:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f26700b65a0 msgr2=0x7f26700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f26700b65a0 0x7f26700b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f267802aa00 tx=0x7f2678031400 comp rx=0 tx=0).stop 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 msgr2=0x7f268819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 0x7f268819a4b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f268400c970 tx=0x7f268400ce30 comp rx=0 tx=0).stop 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 shutdown_connections 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f26700b65a0 0x7f26700b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f268810de10 0x7f268819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2688105300 0x7f268819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 --2- 172.21.15.60:0/127250873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26881049b0 0x7f268819a4b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 >> 172.21.15.60:0/127250873 conn(0x7f2688079730 msgr2=0x7f26881007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:05.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 shutdown_connections 2024-09-21T07:34:05.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:05.205+0000 7f268eb67640 1 -- 172.21.15.60:0/127250873 wait complete. 2024-09-21T07:34:05.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:34:05.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:05 smithi060 ceph-mon[31244]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:05.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:05 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/127250873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:06.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:05 smithi187 ceph-mon[34367]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:06.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:05 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/127250873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:06.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:05 smithi123 ceph-mon[34166]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:05 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/127250873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 -- 172.21.15.60:0/3797243392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 msgr2=0x7fb7e010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/3797243392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e010f550 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009ca0 tx=0x7fb7d802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 -- 172.21.15.60:0/3797243392 shutdown_connections 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/3797243392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e010f550 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/3797243392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7e01083d0 0x7fb7e01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/3797243392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7e0102ae0 0x7fb7e0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 -- 172.21.15.60:0/3797243392 >> 172.21.15.60:0/3797243392 conn(0x7fb7e0079760 msgr2=0x7fb7e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 -- 172.21.15.60:0/3797243392 shutdown_connections 2024-09-21T07:34:06.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.586+0000 7fb7e53a1640 1 -- 172.21.15.60:0/3797243392 wait complete. 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 Processor -- start 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 -- start start 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7e0102ae0 0x7fb7e019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7e01083d0 0x7fb7e019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e0112990 con 0x7fb7e0108d20 2024-09-21T07:34:06.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e0112810 con 0x7fb7e0102ae0 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7e53a1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e0112b10 con 0x7fb7e01083d0 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7deffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7e0102ae0 0x7fb7e019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e019bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42526/0 (socket says 172.21.15.60:42526) 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7df7fe640 1 -- 172.21.15.60:0/759054539 learned_addr learned my addr 172.21.15.60:0/759054539 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.587+0000 7fb7de7fc640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7e01083d0 0x7fb7e019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7df7fe640 1 -- 172.21.15.60:0/759054539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7e01083d0 msgr2=0x7fb7e019b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7df7fe640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7e01083d0 0x7fb7e019b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7df7fe640 1 -- 172.21.15.60:0/759054539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7e0102ae0 msgr2=0x7fb7e019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7df7fe640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7e0102ae0 0x7fb7e019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7df7fe640 1 -- 172.21.15.60:0/759054539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e01a6490 con 0x7fb7e0108d20 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7df7fe640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e019bc80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8005cc0 tx=0x7fb7d802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:06.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8003bf0 con 0x7fb7e0108d20 2024-09-21T07:34:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7d8003d90 con 0x7fb7e0108d20 2024-09-21T07:34:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e01a6720 con 0x7fb7e0108d20 2024-09-21T07:34:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d802fbc0 con 0x7fb7e0108d20 2024-09-21T07:34:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.588+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e01a6c60 con 0x7fb7e0108d20 2024-09-21T07:34:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.589+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e0103d10 con 0x7fb7e0108d20 2024-09-21T07:34:06.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.591+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb7d802fd60 con 0x7fb7e0108d20 2024-09-21T07:34:06.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.591+0000 7fb7c7fff640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb7c80b65d0 0x7fb7c80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:06.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.592+0000 7fb7deffd640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb7c80b65d0 0x7fb7c80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:06.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.592+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fb7d8108850 con 0x7fb7e0108d20 2024-09-21T07:34:06.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.592+0000 7fb7deffd640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb7c80b65d0 0x7fb7c80b8ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7e006c6a0 tx=0x7fb7d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:06.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.595+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7d80cefb0 con 0x7fb7e0108d20 2024-09-21T07:34:06.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.797+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7e006bf50 con 0x7fb7e0108d20 2024-09-21T07:34:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.798+0000 7fb7c7fff640 1 -- 172.21.15.60:0/759054539 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22654 (secure 0 0 0) 0x7fb7e006bf50 con 0x7fb7e0108d20 2024-09-21T07:34:06.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:06.800 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:33:33.924895+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb7c80b65d0 msgr2=0x7fb7c80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb7c80b65d0 0x7fb7c80b8ae0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb7e006c6a0 tx=0x7fb7d000b390 comp rx=0 tx=0).stop 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 msgr2=0x7fb7e019bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e019bc80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8005cc0 tx=0x7fb7d802f380 comp rx=0 tx=0).stop 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 shutdown_connections 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb7c80b65d0 0x7fb7c80b8ae0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e0108d20 0x7fb7e019bc80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7e01083d0 0x7fb7e019b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 --2- 172.21.15.60:0/759054539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7e0102ae0 0x7fb7e019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 >> 172.21.15.60:0/759054539 conn(0x7fb7e0079760 msgr2=0x7fb7e01043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:06.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 shutdown_connections 2024-09-21T07:34:06.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:06.801+0000 7fb7e53a1640 1 -- 172.21.15.60:0/759054539 wait complete. 2024-09-21T07:34:07.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:34:07.689 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:07.970 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:07 smithi060 ceph-mon[31244]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:07.970 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:07 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/759054539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:34:08.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:07 smithi187 ceph-mon[34367]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:08.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:07 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/759054539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:34:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:07 smithi123 ceph-mon[34166]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:08.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:07 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/759054539' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:34:08.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 -- 172.21.15.60:0/517642414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7878105330 msgr2=0x7f787810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:08.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 --2- 172.21.15.60:0/517642414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7878105330 0x7f787810d880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7860009900 tx=0x7f786002a410 comp rx=0 tx=0).stop 2024-09-21T07:34:08.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 -- 172.21.15.60:0/517642414 shutdown_connections 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 --2- 172.21.15.60:0/517642414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f787810de40 0x7f7878110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 --2- 172.21.15.60:0/517642414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7878105330 0x7f787810d880 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 --2- 172.21.15.60:0/517642414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f78781049e0 0x7f7878104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 -- 172.21.15.60:0/517642414 >> 172.21.15.60:0/517642414 conn(0x7f7878079750 msgr2=0x7f7878079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 -- 172.21.15.60:0/517642414 shutdown_connections 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.176+0000 7f787e973640 1 -- 172.21.15.60:0/517642414 wait complete. 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.177+0000 7f787e973640 1 Processor -- start 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.177+0000 7f787e973640 1 -- start start 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.177+0000 7f787e973640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 0x7f787819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.177+0000 7f787e973640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7878105330 0x7f787819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787e973640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787810de40 0x7f787819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787e973640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7878113ae0 con 0x7f78781049e0 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787e973640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7878113960 con 0x7f787810de40 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787e973640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7878113c60 con 0x7f7878105330 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 0x7f787819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 0x7f787819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42532/0 (socket says 172.21.15.60:42532) 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 -- 172.21.15.60:0/931600461 learned_addr learned my addr 172.21.15.60:0/931600461 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f786ffff640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7878105330 0x7f787819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787cf10640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787810de40 0x7f787819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 -- 172.21.15.60:0/931600461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7878105330 msgr2=0x7f787819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7878105330 0x7f787819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 -- 172.21.15.60:0/931600461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787810de40 msgr2=0x7f787819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787810de40 0x7f787819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 -- 172.21.15.60:0/931600461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78781a04a0 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7877fff640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 0x7f787819a530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f786800d950 tx=0x7f786800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7868017020 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7868009c30 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786800f6b0 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78781a0790 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.178+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78781a6ef0 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.180+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787806c280 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.181+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f786801a020 con 0x7f78781049e0 2024-09-21T07:34:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.182+0000 7f7875ffb640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f78640b65a0 0x7f78640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.182+0000 7f786ffff640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f78640b65a0 0x7f78640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.182+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f78680e7520 con 0x7f78781049e0 2024-09-21T07:34:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.182+0000 7f786ffff640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f78640b65a0 0x7f78640b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7860009230 tx=0x7f7860031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.185+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7868009de0 con 0x7f78781049e0 2024-09-21T07:34:08.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.408+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7878104df0 con 0x7f78781049e0 2024-09-21T07:34:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.409+0000 7f7875ffb640 1 -- 172.21.15.60:0/931600461 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f78680adc80 con 0x7f78781049e0 2024-09-21T07:34:08.411 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:08.411 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T07:33:05:373246+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:33:05.146717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24613,24623,24653]},"id":1}]} 2024-09-21T07:34:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:34:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f78640b65a0 msgr2=0x7f78640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f78640b65a0 0x7f78640b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7860009230 tx=0x7f7860031400 comp rx=0 tx=0).stop 2024-09-21T07:34:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 msgr2=0x7f787819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 0x7f787819a530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f786800d950 tx=0x7f786800de10 comp rx=0 tx=0).stop 2024-09-21T07:34:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 shutdown_connections 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f78640b65a0 0x7f78640b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787810de40 0x7f787819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7878105330 0x7f787819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 --2- 172.21.15.60:0/931600461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78781049e0 0x7f787819a530 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.411+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 >> 172.21.15.60:0/931600461 conn(0x7f7878079750 msgr2=0x7f78781008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.412+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 shutdown_connections 2024-09-21T07:34:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:08.412+0000 7f787e973640 1 -- 172.21.15.60:0/931600461 wait complete. 2024-09-21T07:34:09.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:08 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/931600461' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:09.031 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:08 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/931600461' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:09.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:32:53.917796+0000', 'modified': '2024-09-21T07:33:05.146717+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24653, 'mds_1': 24623, 'mds_2': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24586': {'gid': 24586, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.187:6835/1725714173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 1725714173}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 1725714173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.187:6837/4006232422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 4006232422}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 4006232422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/1302227504', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 1302227504}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1302227504}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.187:6839/1132397222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 1132397222}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 1132397222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.123:6837/2557983020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2557983020}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2557983020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6839/4279563434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 4279563434}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 4279563434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24613, 24623, 24653]} 2024-09-21T07:34:09.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T07:34:09.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:34:09.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:08 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/931600461' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:09.323 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 -- 172.21.15.60:0/3643117655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 msgr2=0x7f0810102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 --2- 172.21.15.60:0/3643117655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f0810102ef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f080c009900 tx=0x7f080c02a410 comp rx=0 tx=0).stop 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 -- 172.21.15.60:0/3643117655 shutdown_connections 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 --2- 172.21.15.60:0/3643117655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0810108d20 0x7f081010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 --2- 172.21.15.60:0/3643117655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 0x7f08101087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 --2- 172.21.15.60:0/3643117655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f0810102ef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 -- 172.21.15.60:0/3643117655 >> 172.21.15.60:0/3643117655 conn(0x7f0810079760 msgr2=0x7f0810079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 -- 172.21.15.60:0/3643117655 shutdown_connections 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.809+0000 7f08185f9640 1 -- 172.21.15.60:0/3643117655 wait complete. 2024-09-21T07:34:09.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 Processor -- start 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 -- start start 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f081019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 0x7f081019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0810108d20 0x7f081019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0810112a10 con 0x7f0810102ae0 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0810112890 con 0x7f0810108d20 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f08185f9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0810112b90 con 0x7f08101083d0 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f0816395640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f081019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.810+0000 7f0816395640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f081019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42556/0 (socket says 172.21.15.60:42556) 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 -- 172.21.15.60:0/2497757297 learned_addr learned my addr 172.21.15.60:0/2497757297 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0815b94640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 0x7f081019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 -- 172.21.15.60:0/2497757297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 msgr2=0x7f081019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 0x7f081019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 -- 172.21.15.60:0/2497757297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0810108d20 msgr2=0x7f081019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0810108d20 0x7f081019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 -- 172.21.15.60:0/2497757297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08101a0480 con 0x7f0810102ae0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0815b94640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 0x7f081019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f0816395640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f081019a510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f080c006010 tx=0x7f080c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f08077fe640 1 -- 172.21.15.60:0/2497757297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c03f030 con 0x7f0810102ae0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f08077fe640 1 -- 172.21.15.60:0/2497757297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f080c003800 con 0x7f0810102ae0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08101a0710 con 0x7f0810102ae0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f08077fe640 1 -- 172.21.15.60:0/2497757297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c035070 con 0x7f0810102ae0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.811+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08101a6ed0 con 0x7f0810102ae0 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 Processor -- start 2024-09-21T07:34:09.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 -- start start 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f08077fe640 1 -- 172.21.15.60:0/2497757297 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f080c003cb0 con 0x7f0810102ae0 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e32af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e32b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e32b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55755e2a2c10 con 0x55755df64280 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55755e292040 con 0x55755df5c0a0 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f081eb6d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55755e295e50 con 0x55755df84f60 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f0815b94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e32b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f0815b94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e32b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42562/0 (socket says 172.21.15.60:42562) 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f0815b94640 1 -- 172.21.15.60:0/3191107290 learned_addr learned my addr 172.21.15.60:0/3191107290 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.814+0000 7f0816395640 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e32b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0816b96640 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e32af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0815b94640 1 -- 172.21.15.60:0/3191107290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 msgr2=0x55755e32af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0815b94640 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e32af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0815b94640 1 -- 172.21.15.60:0/3191107290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 msgr2=0x55755e32b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0815b94640 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e32b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0815b94640 1 -- 172.21.15.60:0/3191107290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755dff0540 con 0x55755df64280 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0816b96640 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e32af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0815b94640 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e32b980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f080000bb40 tx=0x7f080000d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c08577a9f2f0207 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0804ff9640 1 -- 172.21.15.60:0/3191107290 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800017420 con 0x55755df64280 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0804ff9640 1 -- 172.21.15.60:0/3191107290 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0800017a70 con 0x55755df64280 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f0804ff9640 1 -- 172.21.15.60:0/3191107290 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080000fb00 con 0x55755df64280 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.815+0000 7f08077fe640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f07fc0b6620 0x7f07fc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f0816b96640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f07fc0b6620 0x7f07fc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f08077fe640 1 -- 172.21.15.60:0/2497757297 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f080c107e40 con 0x7f0810102ae0 2024-09-21T07:34:09.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 -- 172.21.15.60:0/3191107290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 msgr2=0x55755e32b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f0816b96640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f07fc0b6620 0x7f07fc0b8b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0808009ec0 tx=0x7f0808009450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e32b980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f080000bb40 tx=0x7f080000d340 comp rx=0 tx=0).stop 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 -- 172.21.15.60:0/3191107290 shutdown_connections 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e32b980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e32b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3191107290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e32af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 -- 172.21.15.60:0/3191107290 >> 172.21.15.60:0/3191107290 conn(0x55755df79350 msgr2=0x55755e328df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 -- 172.21.15.60:0/3191107290 shutdown_connections 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.816+0000 7f081eb6d740 1 -- 172.21.15.60:0/3191107290 wait complete. 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 -- start start 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 Processor -- start 2024-09-21T07:34:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e33aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df64280 0x55755e33b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e346d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55755e0f35f0 con 0x55755df84f60 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55755e22d010 con 0x55755df5c0a0 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55755e33da10 con 0x55755df64280 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f081eb6d740 10 client.0 _ll_register_callbacks cb 0x55755e28c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f0816b96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e346d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f0816b96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e346d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42564/0 (socket says 172.21.15.60:42564) 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.817+0000 7f0816b96640 1 -- 172.21.15.60:0/3094298079 learned_addr learned my addr 172.21.15.60:0/3094298079 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0815b94640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df64280 0x55755e33b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816395640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e33aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816b96640 1 -- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df64280 msgr2=0x55755e33b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816b96640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df64280 0x55755e33b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816b96640 1 -- 172.21.15.60:0/3094298079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 msgr2=0x55755e33aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816b96640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e33aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816b96640 1 -- 172.21.15.60:0/3094298079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55755e25aa00 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f0816b96640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e346d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0808017b80 tx=0x7f0808004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee89a34c625d206e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f07f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3094298079 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808027060 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0800017a70 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3094298079 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f0808012030 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3094298079 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0808017d30 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f081eb6d740 10 client.15144 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55755e349970 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.818+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3094298079 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0800017a70 con 0x55755df84f60 2024-09-21T07:34:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3094298079 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0808022aa0 con 0x55755df84f60 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f081eb6d740 10 client.15144 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f081eb6d740 10 client.15144 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f081eb6d740 20 client.15144 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df438e0 0x55755e34d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f081eb6d740 4 client.15144 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 --> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55755e2a4b60 con 0x55755df438e0 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.819+0000 7f0816395640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df438e0 0x55755e34d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.820+0000 7f0816395640 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df438e0 0x55755e34d3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b0118b05df5df0f server_cookie=7a19731fd1466cbd in_seq=0 out_seq=0 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.820+0000 7f07f9ffb640 10 client.15144 ms_handle_connect on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.820+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3094298079 <== mds.2 v2:172.21.15.187:6838/1132397222 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55755e2a4b60 con 0x55755df438e0 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.820+0000 7f07f9ffb640 10 client.15144 handle_command_reply: tid=0 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.820+0000 7f081eb6d740 1 client.15144 shutdown 2024-09-21T07:34:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 msgr2=0x55755e346d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e346d70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0808017b80 tx=0x7f0808004bc0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 shutdown_connections 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df438e0 0x55755e34d3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e346d70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df64280 0x55755e33b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3094298079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e33aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f07f9ffb640 0 client.15144 ms_handle_reset on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 >> 172.21.15.60:0/3094298079 conn(0x55755df79350 msgr2=0x55755e32e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 shutdown_connections 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 1 -- 172.21.15.60:0/3094298079 wait complete. 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.821+0000 7f081eb6d740 20 client.15144 trim_cache size 0 max 16384 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 Processor -- start 2024-09-21T07:34:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 -- start start 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e34bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e34ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e335ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55755e34b720 con 0x55755df64280 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55755e34bdf0 con 0x55755df5c0a0 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f081eb6d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55755e34c4c0 con 0x55755df84f60 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f0815b94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e34ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f0815b94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e34ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42574/0 (socket says 172.21.15.60:42574) 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f0815b94640 1 -- 172.21.15.60:0/385630042 learned_addr learned my addr 172.21.15.60:0/385630042 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f0816395640 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e34bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.839+0000 7f0816b96640 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e335ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0815b94640 1 -- 172.21.15.60:0/385630042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 msgr2=0x55755e335ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0815b94640 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e335ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0815b94640 1 -- 172.21.15.60:0/385630042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 msgr2=0x55755e34bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0815b94640 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e34bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0815b94640 1 -- 172.21.15.60:0/385630042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755e329330 con 0x55755df64280 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0816b96640 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e335ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f0815b94640 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e34ade0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0800018000 tx=0x7f080000df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231eb092db3aa92b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f07fbfff640 1 -- 172.21.15.60:0/385630042 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800027070 con 0x55755df64280 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f07fbfff640 1 -- 172.21.15.60:0/385630042 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08000218e0 con 0x55755df64280 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.840+0000 7f07fbfff640 1 -- 172.21.15.60:0/385630042 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080000f8c0 con 0x55755df64280 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 -- 172.21.15.60:0/385630042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 msgr2=0x55755e34ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e34ade0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0800018000 tx=0x7f080000df10 comp rx=0 tx=0).stop 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 -- 172.21.15.60:0/385630042 shutdown_connections 2024-09-21T07:34:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df84f60 0x55755e335ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df64280 0x55755e34ade0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 --2- 172.21.15.60:0/385630042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df5c0a0 0x55755e34bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 -- 172.21.15.60:0/385630042 >> 172.21.15.60:0/385630042 conn(0x55755df79350 msgr2=0x55755e346ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 -- 172.21.15.60:0/385630042 shutdown_connections 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 -- 172.21.15.60:0/385630042 wait complete. 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 -- start start 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.841+0000 7f081eb6d740 1 Processor -- start 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df5c0a0 0x55755e34fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df64280 0x55755e350300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e354c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55755e34d260 con 0x55755df84f60 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55755e34cb90 con 0x55755df64280 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55755e34d930 con 0x55755df5c0a0 2024-09-21T07:34:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f081eb6d740 10 client.0 _ll_register_callbacks cb 0x7f0808009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e354c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e354c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42584/0 (socket says 172.21.15.60:42584) 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 -- 172.21.15.60:0/3387528711 learned_addr learned my addr 172.21.15.60:0/3387528711 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816395640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df5c0a0 0x55755e34fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0815b94640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df64280 0x55755e350300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 -- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df5c0a0 msgr2=0x55755e34fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df5c0a0 0x55755e34fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 -- 172.21.15.60:0/3387528711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df64280 msgr2=0x55755e350300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df64280 0x55755e350300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 -- 172.21.15.60:0/3387528711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55755e355150 con 0x55755df84f60 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f0816b96640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e354c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0808013040 tx=0x7f0808016aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c24df2460ef909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f07f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.842+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3387528711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080803b060 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3387528711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f080802d850 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08000218e0 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3387528711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0808032070 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 10 client.15150 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55755e356340 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3387528711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08000218e0 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3387528711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0808022990 con 0x55755df84f60 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 10 client.15150 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 10 client.15150 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 20 client.15150 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df18c90 0x55755e3bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 4 client.15150 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:34:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 --> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] -- command(tid 0: {"prefix": "status"}) -- 0x55755e2a0610 con 0x55755df18c90 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.843+0000 7f0816395640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df18c90 0x55755e3bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f0816395640 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df18c90 0x55755e3bbe30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae0d1eff86aa7414 server_cookie=f2d991d588883374 in_seq=0 out_seq=0 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f07f9ffb640 10 client.15150 ms_handle_connect on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f07f9ffb640 1 -- 172.21.15.60:0/3387528711 <== mds.2 v2:172.21.15.187:6838/1132397222 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55755e2a0610 con 0x55755df18c90 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f07f9ffb640 10 client.15150 handle_command_reply: tid=0 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 client.15150 shutdown 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 msgr2=0x55755e354c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e354c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0808013040 tx=0x7f0808016aa0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.867 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24613, 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 67.477568828000003, 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 24, 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 76, 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 93.858711536000001 2024-09-21T07:34:09.868 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 shutdown_connections 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55755df18c90 0x55755e3bbe30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55755df84f60 0x55755e354c10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55755df64280 0x55755e350300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f07f9ffb640 0 client.15150 ms_handle_reset on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 --2- 172.21.15.60:0/3387528711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55755df5c0a0 0x55755e34fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 >> 172.21.15.60:0/3387528711 conn(0x55755df79350 msgr2=0x55755e346ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 shutdown_connections 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 1 -- 172.21.15.60:0/3387528711 wait complete. 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.844+0000 7f081eb6d740 20 client.15150 trim_cache size 0 max 16384 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f07fc0b6620 msgr2=0x7f07fc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f07fc0b6620 0x7f07fc0b8b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0808009ec0 tx=0x7f0808009450 comp rx=0 tx=0).stop 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 msgr2=0x7f081019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f081019a510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f080c006010 tx=0x7f080c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 shutdown_connections 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f07fc0b6620 0x7f07fc0b8b30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0810108d20 0x7f081019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08101083d0 0x7f081019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 --2- 172.21.15.60:0/2497757297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0810102ae0 0x7f081019a510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 >> 172.21.15.60:0/2497757297 conn(0x7f0810079760 msgr2=0x7f0810101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 shutdown_connections 2024-09-21T07:34:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:09.845+0000 7f08185f9640 1 -- 172.21.15.60:0/2497757297 wait complete. 2024-09-21T07:34:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:09 smithi187 ceph-mon[34367]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:09 smithi123 ceph-mon[34166]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:10.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:09 smithi060 ceph-mon[31244]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:10.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:34:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 -- 172.21.15.60:0/3351840449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 msgr2=0x7f0438102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 --2- 172.21.15.60:0/3351840449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f0438102a60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0428009ca0 tx=0x7f042802a950 comp rx=0 tx=0).stop 2024-09-21T07:34:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 -- 172.21.15.60:0/3351840449 shutdown_connections 2024-09-21T07:34:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 --2- 172.21.15.60:0/3351840449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0438110200 0x7f0438112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 --2- 172.21.15.60:0/3351840449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0438102fa0 0x7f043810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 --2- 172.21.15.60:0/3351840449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f0438102a60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 -- 172.21.15.60:0/3351840449 >> 172.21.15.60:0/3351840449 conn(0x7f0438079730 msgr2=0x7f0438079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 -- 172.21.15.60:0/3351840449 shutdown_connections 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.378+0000 7f0440095640 1 -- 172.21.15.60:0/3351840449 wait complete. 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 Processor -- start 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 -- start start 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f043819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0438102fa0 0x7f043819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0438110200 0x7f04381a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0438115c70 con 0x7f0438102650 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0438115af0 con 0x7f0438102fa0 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f0440095640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f0438115df0 con 0x7f0438110200 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043de31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f043819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043de31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f043819c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42592/0 (socket says 172.21.15.60:42592) 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043de31640 1 -- 172.21.15.60:0/1655758326 learned_addr learned my addr 172.21.15.60:0/1655758326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043d630640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0438102fa0 0x7f043819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043e632640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0438110200 0x7f04381a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043de31640 1 -- 172.21.15.60:0/1655758326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0438110200 msgr2=0x7f04381a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043de31640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0438110200 0x7f04381a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.379+0000 7f043de31640 1 -- 172.21.15.60:0/1655758326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0438102fa0 msgr2=0x7f043819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f043de31640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0438102fa0 0x7f043819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f043de31640 1 -- 172.21.15.60:0/1655758326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04381a25f0 con 0x7f0438102650 2024-09-21T07:34:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f043de31640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f043819c680 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0428005cc0 tx=0x7f042802f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f0436ffd640 1 -- 172.21.15.60:0/1655758326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428034040 con 0x7f0438102650 2024-09-21T07:34:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04381a2880 con 0x7f0438102650 2024-09-21T07:34:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f0436ffd640 1 -- 172.21.15.60:0/1655758326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0428003e40 con 0x7f0438102650 2024-09-21T07:34:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f0436ffd640 1 -- 172.21.15.60:0/1655758326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428045480 con 0x7f0438102650 2024-09-21T07:34:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.380+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04381a9040 con 0x7f0438102650 2024-09-21T07:34:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0436ffd640 1 -- 172.21.15.60:0/1655758326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0428037020 con 0x7f0438102650 2024-09-21T07:34:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 Processor -- start 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 -- start start 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5edf60 0x55893b993f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b994440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5cd280 0x55893b994980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55893b90bc10 con 0x55893b5c50a0 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55893b8fb040 con 0x55893b5edf60 2024-09-21T07:34:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f0446609740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55893b8fee50 con 0x55893b5cd280 2024-09-21T07:34:11.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f043de31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b994440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f043de31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b994440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42606/0 (socket says 172.21.15.60:42606) 2024-09-21T07:34:11.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.383+0000 7f043de31640 1 -- 172.21.15.60:0/713750792 learned_addr learned my addr 172.21.15.60:0/713750792 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:11.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043d630640 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5cd280 0x55893b994980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043e632640 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5edf60 0x55893b993f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f0436ffd640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04200b65a0 0x7f04200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043de31640 1 -- 172.21.15.60:0/713750792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5cd280 msgr2=0x55893b994980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043de31640 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5cd280 0x55893b994980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043de31640 1 -- 172.21.15.60:0/713750792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5edf60 msgr2=0x55893b993f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043de31640 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5edf60 0x55893b993f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043e632640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04200b65a0 0x7f04200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043de31640 1 -- 172.21.15.60:0/713750792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893b659540 con 0x55893b5c50a0 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f0436ffd640 1 -- 172.21.15.60:0/1655758326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f04281085f0 con 0x7f0438102650 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043de31640 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b994440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0428105f10 tx=0x7f042802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaeea42106fb1110 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f043e632640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04200b65a0 0x7f04200b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04300124d0 tx=0x7f0430004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:11.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.384+0000 7f041ffff640 1 -- 172.21.15.60:0/713750792 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04280ce420 con 0x55893b5c50a0 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f041ffff640 1 -- 172.21.15.60:0/713750792 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042802e300 con 0x55893b5c50a0 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f041ffff640 1 -- 172.21.15.60:0/713750792 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042809a500 con 0x55893b5c50a0 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 -- 172.21.15.60:0/713750792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 msgr2=0x55893b994440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b994440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0428105f10 tx=0x7f042802ed80 comp rx=0 tx=0).stop 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 -- 172.21.15.60:0/713750792 shutdown_connections 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5cd280 0x55893b994980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b994440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 --2- 172.21.15.60:0/713750792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5edf60 0x55893b993f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 -- 172.21.15.60:0/713750792 >> 172.21.15.60:0/713750792 conn(0x55893b5e2350 msgr2=0x55893b991df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.385+0000 7f0446609740 1 -- 172.21.15.60:0/713750792 shutdown_connections 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.386+0000 7f0446609740 1 -- 172.21.15.60:0/713750792 wait complete. 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.386+0000 7f0446609740 1 -- start start 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.386+0000 7f0446609740 1 Processor -- start 2024-09-21T07:34:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b99f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b99fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5edf60 0x55893b9ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55893b75c5f0 con 0x55893b5c50a0 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55893b896010 con 0x55893b5cd280 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55893b9a24a0 con 0x55893b5edf60 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 10 client.0 _ll_register_callbacks cb 0x55893b8f5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b99f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b99f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42616/0 (socket says 172.21.15.60:42616) 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 -- 172.21.15.60:0/3387968203 learned_addr learned my addr 172.21.15.60:0/3387968203 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043e632640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5edf60 0x55893b9ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043d630640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b99fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 -- 172.21.15.60:0/3387968203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5edf60 msgr2=0x55893b9ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5edf60 0x55893b9ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 -- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 msgr2=0x55893b99fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b99fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 -- 172.21.15.60:0/3387968203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55893b8c3a00 con 0x55893b5c50a0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f043de31640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b99f780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f04280cac20 tx=0x7f0428106450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3af5c422cea3d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f041d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f041d7fa640 1 -- 172.21.15.60:0/3387968203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04280cddc0 con 0x55893b5c50a0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f041d7fa640 1 -- 172.21.15.60:0/3387968203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f042802edf0 con 0x55893b5c50a0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.387+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55893b90db60 con 0x55893b5c50a0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f041d7fa640 1 -- 172.21.15.60:0/3387968203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f04280cdfa0 con 0x55893b5c50a0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 10 client.15162 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55893b9ae270 con 0x55893b5c50a0 2024-09-21T07:34:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f041d7fa640 1 -- 172.21.15.60:0/3387968203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55893b90db60 con 0x55893b5c50a0 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f041d7fa640 1 -- 172.21.15.60:0/3387968203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f042804d030 con 0x55893b5c50a0 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 10 client.15162 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 10 client.15162 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 20 client.15162 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5ac8e0 0x55893b9b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 4 client.15162 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.388+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 --> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55893b909610 con 0x55893b5ac8e0 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.389+0000 7f043d630640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5ac8e0 0x55893b9b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.389+0000 7f043d630640 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5ac8e0 0x55893b9b1c20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12e525d03896f4ce server_cookie=cb88028a6ea0fccc in_seq=0 out_seq=0 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.389+0000 7f041d7fa640 10 client.15162 ms_handle_connect on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f041d7fa640 1 -- 172.21.15.60:0/3387968203 <== mds.1 v2:172.21.15.123:6836/2557983020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55893b909610 con 0x55893b5ac8e0 2024-09-21T07:34:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f041d7fa640 10 client.15162 handle_command_reply: tid=0 2024-09-21T07:34:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 client.15162 shutdown 2024-09-21T07:34:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 msgr2=0x55893b99f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b99f780 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f04280cac20 tx=0x7f0428106450 comp rx=0 tx=0).stop 2024-09-21T07:34:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 shutdown_connections 2024-09-21T07:34:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5ac8e0 0x55893b9b1c20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5edf60 0x55893b9ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b99fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f041d7fa640 0 client.15162 ms_handle_reset on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 --2- 172.21.15.60:0/3387968203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b99f780 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 >> 172.21.15.60:0/3387968203 conn(0x55893b5e2350 msgr2=0x55893b997090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 shutdown_connections 2024-09-21T07:34:11.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 1 -- 172.21.15.60:0/3387968203 wait complete. 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.390+0000 7f0446609740 20 client.15162 trim_cache size 0 max 16384 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 Processor -- start 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 -- start start 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5ac8e0 0x55893b99a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b9ab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b9abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55893b9aff60 con 0x55893b5c50a0 2024-09-21T07:34:11.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55893b9b0630 con 0x55893b5cd280 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f0446609740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55893b9b0d00 con 0x55893b5ac8e0 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b9ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b9ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42624/0 (socket says 172.21.15.60:42624) 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 -- 172.21.15.60:0/3418625295 learned_addr learned my addr 172.21.15.60:0/3418625295 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 -- 172.21.15.60:0/3418625295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5ac8e0 msgr2=0x55893b99a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043de31640 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5ac8e0 0x55893b99a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5ac8e0 0x55893b99a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 -- 172.21.15.60:0/3418625295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 msgr2=0x55893b9abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b9abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 -- 172.21.15.60:0/3418625295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893b9afd90 con 0x55893b5c50a0 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043de31640 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5ac8e0 0x55893b99a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.409+0000 7f043d630640 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b9ab670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c3b0 tx=0x7f042c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e842a8903f8a2a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:11.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f041f7fe640 1 -- 172.21.15.60:0/3418625295 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c00cdd0 con 0x55893b5c50a0 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f041f7fe640 1 -- 172.21.15.60:0/3418625295 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c0054d0 con 0x55893b5c50a0 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f041f7fe640 1 -- 172.21.15.60:0/3418625295 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c01c690 con 0x55893b5c50a0 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 -- 172.21.15.60:0/3418625295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 msgr2=0x55893b9ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b9ab670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c3b0 tx=0x7f042c010800 comp rx=0 tx=0).stop 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 -- 172.21.15.60:0/3418625295 shutdown_connections 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5cd280 0x55893b9abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5c50a0 0x55893b9ab670 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 --2- 172.21.15.60:0/3418625295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5ac8e0 0x55893b99a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 -- 172.21.15.60:0/3418625295 >> 172.21.15.60:0/3418625295 conn(0x55893b5e2350 msgr2=0x55893b99f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.410+0000 7f0446609740 1 -- 172.21.15.60:0/3418625295 shutdown_connections 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 -- 172.21.15.60:0/3418625295 wait complete. 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 -- start start 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 Processor -- start 2024-09-21T07:34:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5ac8e0 0x55893b9b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5c50a0 0x55893b9b8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 0x55893b9b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55893b9b1aa0 con 0x55893b5cd280 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55893b9b13d0 con 0x55893b5ac8e0 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55893b9b2170 con 0x55893b5c50a0 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.411+0000 7f0446609740 10 client.0 _ll_register_callbacks cb 0x7f042c00c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 0x55893b9b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 0x55893b9b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42636/0 (socket says 172.21.15.60:42636) 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 -- 172.21.15.60:0/340345421 learned_addr learned my addr 172.21.15.60:0/340345421 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043d630640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5c50a0 0x55893b9b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043de31640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5ac8e0 0x55893b9b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 -- 172.21.15.60:0/340345421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5c50a0 msgr2=0x55893b9b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5c50a0 0x55893b9b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 -- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5ac8e0 msgr2=0x55893b9b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5ac8e0 0x55893b9b7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 -- 172.21.15.60:0/340345421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55893b9b3c60 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f043e632640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 0x55893b9b35a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0430010d80 tx=0x7f043000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad91a257322e3160 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f041d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f041d7fa640 1 -- 172.21.15.60:0/340345421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430018070 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f041d7fa640 1 -- 172.21.15.60:0/340345421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f0430004220 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f042c0054d0 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f041d7fa640 1 -- 172.21.15.60:0/340345421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0430004420 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f0446609740 10 client.15168 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.412+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55893b9b9610 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f041d7fa640 1 -- 172.21.15.60:0/340345421 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f042c0054d0 con 0x55893b5cd280 2024-09-21T07:34:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f041d7fa640 1 -- 172.21.15.60:0/340345421 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0430027070 con 0x55893b5cd280 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f0446609740 10 client.15168 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f0446609740 10 client.15168 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f0446609740 20 client.15168 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f0446609740 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5edf60 0x55893ba20390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f0446609740 4 client.15168 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 --> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] -- command(tid 0: {"prefix": "status"}) -- 0x55893b906a40 con 0x55893b5edf60 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.413+0000 7f043de31640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5edf60 0x55893ba20390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f043de31640 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5edf60 0x55893ba20390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0e2f59425486b00 server_cookie=a66126d6cef7b55b in_seq=0 out_seq=0 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f041d7fa640 10 client.15168 ms_handle_connect on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f041d7fa640 1 -- 172.21.15.60:0/340345421 <== mds.1 v2:172.21.15.123:6836/2557983020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55893b906a40 con 0x55893b5edf60 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f041d7fa640 10 client.15168 handle_command_reply: tid=0 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 client.15168 shutdown 2024-09-21T07:34:11.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 msgr2=0x55893b9b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 0x55893b9b35a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0430010d80 tx=0x7f043000c990 comp rx=0 tx=0).stop 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 shutdown_connections 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x55893b5edf60 0x55893ba20390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55893b5cd280 0x55893b9b35a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55893b5c50a0 0x55893b9b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f041d7fa640 0 client.15168 ms_handle_reset on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 --2- 172.21.15.60:0/340345421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55893b5ac8e0 0x55893b9b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 >> 172.21.15.60:0/340345421 conn(0x55893b5e2350 msgr2=0x55893b99a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 shutdown_connections 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 1 -- 172.21.15.60:0/340345421 wait complete. 2024-09-21T07:34:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.414+0000 7f0446609740 20 client.15168 trim_cache size 0 max 16384 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24623, 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 70.053537235999997, 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 24, 2024-09-21T07:34:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 76, 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 97.922199711999994 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04200b65a0 msgr2=0x7f04200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04200b65a0 0x7f04200b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04300124d0 tx=0x7f0430004730 comp rx=0 tx=0).stop 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 msgr2=0x7f043819c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:11.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f043819c680 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0428005cc0 tx=0x7f042802f650 comp rx=0 tx=0).stop 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 shutdown_connections 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f04200b65a0 0x7f04200b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0438110200 0x7f04381a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0438102fa0 0x7f043819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 --2- 172.21.15.60:0/1655758326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0438102650 0x7f043819c680 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 >> 172.21.15.60:0/1655758326 conn(0x7f0438079730 msgr2=0x7f0438108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 shutdown_connections 2024-09-21T07:34:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:11.415+0000 7f0440095640 1 -- 172.21.15.60:0/1655758326 wait complete. 2024-09-21T07:34:12.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:11 smithi187 ceph-mon[34367]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:12.074 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:11 smithi060 ceph-mon[31244]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:12.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:11 smithi123 ceph-mon[34166]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:12.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:34:12.356 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/86663266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b2410de60 msgr2=0x7f8b24110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/86663266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b2410de60 0x7f8b24110330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009ca0 tx=0x7f8b1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/86663266 shutdown_connections 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/86663266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b2410de60 0x7f8b24110330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/86663266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24105380 0x7f8b2410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/86663266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b24104a30 0x7f8b24104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/86663266 >> 172.21.15.60:0/86663266 conn(0x7f8b24079760 msgr2=0x7f8b24079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:12.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/86663266 shutdown_connections 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.852+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/86663266 wait complete. 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 Processor -- start 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 -- start start 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24104a30 0x7f8b2419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 0x7f8b2419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b2410de60 0x7f8b2419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24113aa0 con 0x7f8b24105380 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24113920 con 0x7f8b24104a30 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b2a8d0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24113c20 con 0x7f8b2410de60 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 0x7f8b2419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 0x7f8b2419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42642/0 (socket says 172.21.15.60:42642) 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 -- 172.21.15.60:0/537681068 learned_addr learned my addr 172.21.15.60:0/537681068 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b23fff640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24104a30 0x7f8b2419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b2410de60 0x7f8b2419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 -- 172.21.15.60:0/537681068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b2410de60 msgr2=0x7f8b2419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b2410de60 0x7f8b2419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 -- 172.21.15.60:0/537681068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24104a30 msgr2=0x7f8b2419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24104a30 0x7f8b2419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b1bfff640 1 -- 172.21.15.60:0/537681068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b241a0360 con 0x7f8b24105380 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b23fff640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24104a30 0x7f8b2419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.853+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b2410de60 0x7f8b2419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.854+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 0x7f8b2419a990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00d740 tx=0x7f8b0c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:12.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.854+0000 7f8b21ffb640 1 -- 172.21.15.60:0/537681068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c017070 con 0x7f8b24105380 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.854+0000 7f8b21ffb640 1 -- 172.21.15.60:0/537681068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b0c00de50 con 0x7f8b24105380 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.854+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b241a0650 con 0x7f8b24105380 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.854+0000 7f8b21ffb640 1 -- 172.21.15.60:0/537681068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c00f620 con 0x7f8b24105380 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.854+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b241a6db0 con 0x7f8b24105380 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.856+0000 7f8b30e44740 1 Processor -- start 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.856+0000 7f8b30e44740 1 -- start start 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b21ffb640 1 -- 172.21.15.60:0/537681068 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8b0c01a070 con 0x7f8b24105380 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef63f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef64440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef64980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b30e44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c28eedbc10 con 0x55c28eb9d280 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b30e44740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c28eecb040 con 0x55c28eb950a0 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b30e44740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55c28eecee50 con 0x55c28ebbdf60 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef64980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b28e6d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef63f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef64980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42658/0 (socket says 172.21.15.60:42658) 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 -- 172.21.15.60:0/1524015077 learned_addr learned my addr 172.21.15.60:0/1524015077 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b23fff640 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef64440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 -- 172.21.15.60:0/1524015077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 msgr2=0x55c28ef63f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef63f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 -- 172.21.15.60:0/1524015077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 msgr2=0x55c28ef64440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef64440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.857+0000 7f8b1bfff640 1 -- 172.21.15.60:0/1524015077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28ec29540 con 0x55c28eb9d280 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef64980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0e47b0 tx=0x7f8b0c0eaf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc3461d5b573583 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b1a7fc640 1 -- 172.21.15.60:0/1524015077 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0fa070 con 0x55c28eb9d280 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b1a7fc640 1 -- 172.21.15.60:0/1524015077 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b0c0f5ab0 con 0x55c28eb9d280 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b1a7fc640 1 -- 172.21.15.60:0/1524015077 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0f4b20 con 0x55c28eb9d280 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b21ffb640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b100b6620 0x7f8b100b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b100b6620 0x7f8b100b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.858+0000 7f8b21ffb640 1 -- 172.21.15.60:0/537681068 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f8b0c0e6e90 con 0x7f8b24105380 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 -- 172.21.15.60:0/1524015077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 msgr2=0x55c28ef64980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef64980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0e47b0 tx=0x7f8b0c0eaf90 comp rx=0 tx=0).stop 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b100b6620 0x7f8b100b8b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c004af0 tx=0x7f8b1c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 -- 172.21.15.60:0/1524015077 shutdown_connections 2024-09-21T07:34:12.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef64980 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef64440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1524015077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef63f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 -- 172.21.15.60:0/1524015077 >> 172.21.15.60:0/1524015077 conn(0x55c28ebb2350 msgr2=0x55c28ef61df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 -- 172.21.15.60:0/1524015077 shutdown_connections 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 -- 172.21.15.60:0/1524015077 wait complete. 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 -- start start 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.859+0000 7f8b30e44740 1 Processor -- start 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 0x55c28ef6f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef6ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef7ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c28ed2c5f0 con 0x55c28eb950a0 2024-09-21T07:34:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c28ee66010 con 0x55c28eb9d280 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef726e0 con 0x55c28ebbdf60 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b30e44740 10 client.0 _ll_register_callbacks cb 0x55c28eec5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 0x55c28ef6f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 0x55c28ef6f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42660/0 (socket says 172.21.15.60:42660) 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 -- 172.21.15.60:0/2093828414 learned_addr learned my addr 172.21.15.60:0/2093828414 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef6ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 -- 172.21.15.60:0/2093828414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 msgr2=0x55c28ef7ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef7ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 -- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 msgr2=0x55c28ef6ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef6ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 -- 172.21.15.60:0/2093828414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28ee93a00 con 0x55c28eb950a0 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b23fff640 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 0x55c28ef6f9d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400ce20 tx=0x7f8b140039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2061df3171ac50a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.860+0000 7f8b037fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b037fe640 1 -- 172.21.15.60:0/2093828414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14005220 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b0c0f5ab0 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b037fe640 1 -- 172.21.15.60:0/2093828414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f8b140053c0 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b037fe640 1 -- 172.21.15.60:0/2093828414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8b140055c0 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 10 client.15180 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c28ef7e6c0 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b037fe640 1 -- 172.21.15.60:0/2093828414 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b0c0f5ab0 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b037fe640 1 -- 172.21.15.60:0/2093828414 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8b14018070 con 0x55c28eb950a0 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 10 client.15180 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 20 client.15180 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28eb7c8e0 0x55c28ef82260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 4 client.15180 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.861+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 --> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c28eeddb60 con 0x55c28eb7c8e0 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.862+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28eb7c8e0 0x55c28ef82260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.862+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28eb7c8e0 0x55c28ef82260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7942b773b12b2829 server_cookie=b3cb1aa8e75cf577 in_seq=0 out_seq=0 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.862+0000 7f8b037fe640 10 client.15180 ms_handle_connect on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b037fe640 1 -- 172.21.15.60:0/2093828414 <== mds.0 v2:172.21.15.123:6838/4279563434 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c28eeddb60 con 0x55c28eb7c8e0 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b037fe640 10 client.15180 handle_command_reply: tid=0 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 client.15180 shutdown 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 msgr2=0x55c28ef6f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 0x55c28ef6f9d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400ce20 tx=0x7f8b140039c0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 shutdown_connections 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28eb7c8e0 0x55c28ef82260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28ebbdf60 0x55c28ef7ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef6ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b037fe640 0 client.15180 ms_handle_reset on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 --2- 172.21.15.60:0/2093828414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb950a0 0x55c28ef6f9d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 >> 172.21.15.60:0/2093828414 conn(0x55c28ebb2350 msgr2=0x55c28ef67090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 shutdown_connections 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 1 -- 172.21.15.60:0/2093828414 wait complete. 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.863+0000 7f8b30e44740 20 client.15180 trim_cache size 0 max 16384 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 Processor -- start 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 -- start start 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 0x55c28ef6a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb950a0 0x55c28ef7b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef7bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef805a0 con 0x55c28eb7c8e0 2024-09-21T07:34:12.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef80c70 con 0x55c28eb9d280 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b30e44740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef81340 con 0x55c28eb950a0 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 0x55c28ef6a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 0x55c28ef6a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42664/0 (socket says 172.21.15.60:42664) 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 -- 172.21.15.60:0/3872151200 learned_addr learned my addr 172.21.15.60:0/3872151200 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef7bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b1bfff640 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb950a0 0x55c28ef7b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 -- 172.21.15.60:0/3872151200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb950a0 msgr2=0x55c28ef7b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb950a0 0x55c28ef7b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 -- 172.21.15.60:0/3872151200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 msgr2=0x55c28ef7bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef7bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 -- 172.21.15.60:0/3872151200 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c28ef6dcd0 con 0x55c28eb7c8e0 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.882+0000 7f8b23fff640 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 0x55c28ef6a020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8b140057c0 tx=0x7f8b1400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ed130b4f46c012 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:12.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.883+0000 7f8b19ffb640 1 -- 172.21.15.60:0/3872151200 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14005020 con 0x55c28eb7c8e0 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.883+0000 7f8b19ffb640 1 -- 172.21.15.60:0/3872151200 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14004b30 con 0x55c28eb7c8e0 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.883+0000 7f8b19ffb640 1 -- 172.21.15.60:0/3872151200 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14024c50 con 0x55c28eb7c8e0 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 -- 172.21.15.60:0/3872151200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 msgr2=0x55c28ef6a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 0x55c28ef6a020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8b140057c0 tx=0x7f8b1400c770 comp rx=0 tx=0).stop 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 -- 172.21.15.60:0/3872151200 shutdown_connections 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb9d280 0x55c28ef7bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb950a0 0x55c28ef7b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 --2- 172.21.15.60:0/3872151200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb7c8e0 0x55c28ef6a020 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 -- 172.21.15.60:0/3872151200 >> 172.21.15.60:0/3872151200 conn(0x55c28ebb2350 msgr2=0x55c28ef7fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 -- 172.21.15.60:0/3872151200 shutdown_connections 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 -- 172.21.15.60:0/3872151200 wait complete. 2024-09-21T07:34:12.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 -- start start 2024-09-21T07:34:12.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.884+0000 7f8b30e44740 1 Processor -- start 2024-09-21T07:34:12.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 0x55c28ef8a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef8ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef83e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef820e0 con 0x55c28eb9d280 2024-09-21T07:34:12.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef81a10 con 0x55c28eb950a0 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55c28ef827b0 con 0x55c28eb7c8e0 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b30e44740 10 client.0 _ll_register_callbacks cb 0x7f8b14004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 0x55c28ef8a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef8ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef83e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b23fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 0x55c28ef8a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.60:47236/0 (socket says 172.21.15.60:47236) 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b1bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef8ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.60:45358/0 (socket says 172.21.15.60:45358) 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b23fff640 1 -- 172.21.15.60:0/1663542391 learned_addr learned my addr 172.21.15.60:0/1663542391 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef83e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42670/0 (socket says 172.21.15.60:42670) 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 -- 172.21.15.60:0/1663542391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 msgr2=0x55c28ef8a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 0x55c28ef8a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 -- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 msgr2=0x55c28ef8ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef8ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b28e6d640 1 -- 172.21.15.60:0/1663542391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28ef845c0 con 0x55c28eb9d280 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.885+0000 7f8b23fff640 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 0x55c28ef8a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b28e6d640 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef83e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006010 tx=0x7f8b1c031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addce20d4988ffef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b037fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b037fe640 1 -- 172.21.15.60:0/1663542391 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c003e00 con 0x55c28eb9d280 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b037fe640 1 -- 172.21.15.60:0/1663542391 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f8b1c041030 con 0x55c28eb9d280 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b14004b30 con 0x55c28eb9d280 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b037fe640 1 -- 172.21.15.60:0/1663542391 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8b1c004250 con 0x55c28eb9d280 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b30e44740 10 client.15186 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c28ef89fa0 con 0x55c28eb9d280 2024-09-21T07:34:12.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b037fe640 1 -- 172.21.15.60:0/1663542391 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14004b30 con 0x55c28eb9d280 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b037fe640 1 -- 172.21.15.60:0/1663542391 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8b1c0305c0 con 0x55c28eb9d280 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b30e44740 10 client.15186 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b30e44740 10 client.15186 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.886+0000 7f8b30e44740 20 client.15186 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28ebbdf60 0x55c28eff0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b30e44740 4 client.15186 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 --> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] -- command(tid 0: {"prefix": "status"}) -- 0x55c28eed9610 con 0x55c28ebbdf60 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b23fff640 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28ebbdf60 0x55c28eff0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b23fff640 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28ebbdf60 0x55c28eff0b70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6458f664888a90 server_cookie=ac1bf2848d30a588 in_seq=0 out_seq=0 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b037fe640 10 client.15186 ms_handle_connect on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b037fe640 1 -- 172.21.15.60:0/1663542391 <== mds.0 v2:172.21.15.123:6838/4279563434 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c28eed9610 con 0x55c28ebbdf60 2024-09-21T07:34:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b037fe640 10 client.15186 handle_command_reply: tid=0 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.887+0000 7f8b30e44740 1 client.15186 shutdown 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 msgr2=0x55c28ef83e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef83e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006010 tx=0x7f8b1c031960 comp rx=0 tx=0).stop 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 shutdown_connections 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x55c28ebbdf60 0x55c28eff0b70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c28eb9d280 0x55c28ef83e30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c28eb950a0 0x55c28ef8ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 --2- 172.21.15.60:0/1663542391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c28eb7c8e0 0x55c28ef8a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 >> 172.21.15.60:0/1663542391 conn(0x55c28ebb2350 msgr2=0x55c28ef6a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b037fe640 0 client.15186 ms_handle_reset on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 shutdown_connections 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 1 -- 172.21.15.60:0/1663542391 wait complete. 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b30e44740 20 client.15186 trim_cache size 0 max 16384 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24653, 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-21T07:34:12.906 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 78.556589048000006, 2024-09-21T07:34:12.907 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 24, 2024-09-21T07:34:12.907 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 76, 2024-09-21T07:34:12.907 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T07:34:12.907 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 88.726023100999996 2024-09-21T07:34:12.907 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:34:12.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b100b6620 msgr2=0x7f8b100b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b100b6620 0x7f8b100b8b30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c004af0 tx=0x7f8b1c005d80 comp rx=0 tx=0).stop 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 msgr2=0x7f8b2419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.888+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 0x7f8b2419a990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00d740 tx=0x7f8b0c00dc00 comp rx=0 tx=0).stop 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 shutdown_connections 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f8b100b6620 0x7f8b100b8b30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b2410de60 0x7f8b2419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b24105380 0x7f8b2419a990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 --2- 172.21.15.60:0/537681068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b24104a30 0x7f8b2419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 >> 172.21.15.60:0/537681068 conn(0x7f8b24079760 msgr2=0x7f8b24100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 shutdown_connections 2024-09-21T07:34:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:12.889+0000 7f8b2a8d0640 1 -- 172.21.15.60:0/537681068 wait complete. 2024-09-21T07:34:13.576 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T07:34:13.577 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:34:13.586 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T07:34:13.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T07:34:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:13.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:13 smithi060 ceph-mon[31244]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T07:34:14.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:13 smithi187 ceph-mon[34367]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T07:34:14.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:13 smithi123 ceph-mon[34166]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 -- 172.21.15.60:0/190712841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104080 msgr2=0x7fcef410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 --2- 172.21.15.60:0/190712841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104080 0x7fcef410aa20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fceec009ca0 tx=0x7fceec02a950 comp rx=0 tx=0).stop 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 -- 172.21.15.60:0/190712841 shutdown_connections 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 --2- 172.21.15.60:0/190712841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104080 0x7fcef410aa20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 --2- 172.21.15.60:0/190712841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef41036e0 0x7fcef4103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 --2- 172.21.15.60:0/190712841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef4102650 0x7fcef4102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 -- 172.21.15.60:0/190712841 >> 172.21.15.60:0/190712841 conn(0x7fcef40fdfa0 msgr2=0x7fcef4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 -- 172.21.15.60:0/190712841 shutdown_connections 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.321+0000 7fcef9665640 1 -- 172.21.15.60:0/190712841 wait complete. 2024-09-21T07:34:14.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.322+0000 7fcef9665640 1 Processor -- start 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.322+0000 7fcef9665640 1 -- start start 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef4102650 0x7fcef419c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 0x7fcef419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef4104080 0x7fcef419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcef410e280 con 0x7fcef41036e0 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcef410e100 con 0x7fcef4104080 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcef410e400 con 0x7fcef4102650 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 0x7fcef419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 0x7fcef419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42694/0 (socket says 172.21.15.60:42694) 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 -- 172.21.15.60:0/278639490 learned_addr learned my addr 172.21.15.60:0/278639490 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:14.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef2ffd640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef4102650 0x7fcef419c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef37fe640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef4104080 0x7fcef419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 -- 172.21.15.60:0/278639490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef4102650 msgr2=0x7fcef419c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef4102650 0x7fcef419c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 -- 172.21.15.60:0/278639490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef4104080 msgr2=0x7fcef419d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef4104080 0x7fcef419d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 -- 172.21.15.60:0/278639490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef419dbc0 con 0x7fcef41036e0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef27fc640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 0x7fcef419c800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c890 tx=0x7fcee800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8004220 con 0x7fcef41036e0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee80043c0 con 0x7fcef41036e0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef419deb0 con 0x7fcef41036e0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.323+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8004a00 con 0x7fcef41036e0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.324+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef41a45b0 con 0x7fcef41036e0 2024-09-21T07:34:14.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.324+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef41a4780 con 0x7fcef41036e0 2024-09-21T07:34:14.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.327+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcee80079b0 con 0x7fcef41036e0 2024-09-21T07:34:14.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.328+0000 7fcedbfff640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcedc0b65a0 0x7fcedc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:14.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.328+0000 7fcef2ffd640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcedc0b65a0 0x7fcedc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:14.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.328+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fcee80e75a0 con 0x7fcef41036e0 2024-09-21T07:34:14.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.328+0000 7fcef2ffd640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcedc0b65a0 0x7fcedc0b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcee400bbe0 tx=0x7fcee400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:14.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.331+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcee8014030 con 0x7fcef41036e0 2024-09-21T07:34:14.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.559+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fcef406c1a0 con 0x7fcedc0b65a0 2024-09-21T07:34:14.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.560+0000 7fcedbfff640 1 -- 172.21.15.60:0/278639490 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fcef406c1a0 con 0x7fcedc0b65a0 2024-09-21T07:34:14.562 INFO:teuthology.orchestra.run.smithi060.stdout:Backend: cephadm 2024-09-21T07:34:14.562 INFO:teuthology.orchestra.run.smithi060.stdout:Available: Yes 2024-09-21T07:34:14.562 INFO:teuthology.orchestra.run.smithi060.stdout:Paused: No 2024-09-21T07:34:14.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.562+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcedc0b65a0 msgr2=0x7fcedc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:14.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.562+0000 7fcef9665640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcedc0b65a0 0x7fcedc0b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcee400bbe0 tx=0x7fcee400b390 comp rx=0 tx=0).stop 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.562+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 msgr2=0x7fcef419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.562+0000 7fcef9665640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 0x7fcef419c800 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c890 tx=0x7fcee800cd50 comp rx=0 tx=0).stop 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 shutdown_connections 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcedc0b65a0 0x7fcedc0b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcef4104080 0x7fcef419d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41036e0 0x7fcef419c800 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 --2- 172.21.15.60:0/278639490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef4102650 0x7fcef419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 >> 172.21.15.60:0/278639490 conn(0x7fcef40fdfa0 msgr2=0x7fcef406ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 shutdown_connections 2024-09-21T07:34:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:14.563+0000 7fcef9665640 1 -- 172.21.15.60:0/278639490 wait complete. 2024-09-21T07:34:15.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T07:34:15.473 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:15.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:15 smithi060 ceph-mon[31244]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:15 smithi060 ceph-mon[31244]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/2603515671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f98104070 msgr2=0x7f4f9810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/2603515671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f98104070 0x7f4f9810aa10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009ca0 tx=0x7f4f9002a950 comp rx=0 tx=0).stop 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/2603515671 shutdown_connections 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/2603515671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f98104070 0x7f4f9810aa10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/2603515671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f981036d0 0x7f4f98103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/2603515671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98102640 0x7f4f98102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/2603515671 >> 172.21.15.60:0/2603515671 conn(0x7f4f980fdfb0 msgr2=0x7f4f98100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/2603515671 shutdown_connections 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.925+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/2603515671 wait complete. 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 Processor -- start 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 -- start start 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98102640 0x7f4f9819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 0x7f4f9819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f98104070 0x7f4f9819d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9810e270 con 0x7f4f981036d0 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9810e0f0 con 0x7f4f98102640 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.926+0000 7f4f9ddf2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9810e3f0 con 0x7f4f98104070 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 0x7f4f9819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 0x7f4f9819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42726/0 (socket says 172.21.15.60:42726) 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 -- 172.21.15.60:0/4012765165 learned_addr learned my addr 172.21.15.60:0/4012765165 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f97fff640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f98104070 0x7f4f9819d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f977fe640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98102640 0x7f4f9819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 -- 172.21.15.60:0/4012765165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f98104070 msgr2=0x7f4f9819d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f98104070 0x7f4f9819d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 -- 172.21.15.60:0/4012765165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98102640 msgr2=0x7f4f9819c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98102640 0x7f4f9819c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 -- 172.21.15.60:0/4012765165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9819db30 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f96ffd640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 0x7f4f9819c800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00d950 tx=0x7f4f8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c017030 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9819de20 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f8c004020 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0047a0 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.927+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f981a45b0 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.928+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f981a4780 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.930+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4f8c009a30 con 0x7f4f981036d0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.931+0000 7f4f94ff9640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4f800b65a0 0x7f4f800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.931+0000 7f4f977fe640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4f800b65a0 0x7f4f800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.931+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f4f8c0e7570 con 0x7f4f981036d0 2024-09-21T07:34:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.931+0000 7f4f977fe640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4f800b65a0 0x7f4f800b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800ba40 tx=0x7f4f88005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:15.934+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f8c0adcd0 con 0x7f4f981036d0 2024-09-21T07:34:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:15 smithi187 ceph-mon[34367]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:15 smithi187 ceph-mon[34367]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:16.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:15 smithi123 ceph-mon[34166]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:16.182 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:15 smithi123 ceph-mon[34166]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.134+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4f980fff90 con 0x7f4f800b65a0 2024-09-21T07:34:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.146+0000 7f4f94ff9640 1 -- 172.21.15.60:0/4012765165 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f4f980fff90 con 0x7f4f800b65a0 2024-09-21T07:34:16.184 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T07:34:16.184 INFO:teuthology.orchestra.run.smithi060.stdout:mds.a smithi060 running (94s) 17s ago 94s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 837237be24a2 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.b smithi123 running (92s) 25s ago 91s 96.4M - 19.3.0-5120-g18432218 ddce307e1f32 10e6b19890ce 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.c smithi187 running (105s) 25s ago 105s 84.8M - 19.3.0-5120-g18432218 ddce307e1f32 b6afb6761bf4 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.d smithi060 running (113s) 17s ago 112s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 cbeeac9bc47c 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.e smithi123 running (110s) 25s ago 110s 86.5M - 19.3.0-5120-g18432218 ddce307e1f32 d2a69f14520e 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.f smithi187 running (108s) 25s ago 107s 85.3M - 19.3.0-5120-g18432218 ddce307e1f32 ee2914c119e4 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.g smithi060 running (97s) 17s ago 96s 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 a30b05983e16 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.h smithi123 running (103s) 25s ago 102s 86.1M - 19.3.0-5120-g18432218 ddce307e1f32 aefdfa999a61 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.i smithi187 running (100s) 25s ago 100s 85.4M - 19.3.0-5120-g18432218 ddce307e1f32 f850835d2b81 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.j smithi060 running (115s) 17s ago 115s 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 f79407b53b8a 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.k smithi123 running (118s) 25s ago 118s 82.5M - 19.3.0-5120-g18432218 ddce307e1f32 de7b1a3884ec 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mds.l smithi187 running (2m) 25s ago 2m 81.7M - 19.3.0-5120-g18432218 ddce307e1f32 ff26f2125b94 2024-09-21T07:34:16.185 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.x smithi060 *:9283,8765 running (9m) 17s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 cd65c878540b 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.y smithi123 *:8443,8765 running (7m) 25s ago 7m 525M - 19.3.0-5120-g18432218 ddce307e1f32 0194e1fe0d62 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.z smithi187 *:8443,8765 running (7m) 25s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 f0a4d785a51c 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:mon.a smithi060 running (9m) 17s ago 9m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 bd8556fbf099 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:mon.b smithi123 running (7m) 25s ago 7m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 368ee80839d3 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:mon.c smithi187 running (8m) 25s ago 8m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 a171f0dd1e34 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 17s ago 6m 118M 4273M 19.3.0-5120-g18432218 ddce307e1f32 6510ffa92d9f 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi123 running (6m) 25s ago 6m 126M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f1868d60837a 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi187 running (6m) 25s ago 6m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f55edc2ce182 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi060 running (5m) 17s ago 5m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 69c1c36015f4 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi123 running (5m) 25s ago 5m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9dad3528309c 2024-09-21T07:34:16.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi187 running (4m) 25s ago 4m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e660f0a94c11 2024-09-21T07:34:16.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 smithi060 running (4m) 17s ago 4m 116M 4273M 19.3.0-5120-g18432218 ddce307e1f32 3c7846e481bd 2024-09-21T07:34:16.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 smithi123 running (3m) 25s ago 3m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e70ced9bd12f 2024-09-21T07:34:16.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 smithi187 running (3m) 25s ago 3m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0e2e0dd77b9d 2024-09-21T07:34:16.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 smithi060 running (3m) 17s ago 3m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 d23d4247457d 2024-09-21T07:34:16.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 smithi123 running (2m) 25s ago 2m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1a703804ed8e 2024-09-21T07:34:16.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 smithi187 running (2m) 25s ago 2m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dc16ddb0b50b 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4f800b65a0 msgr2=0x7f4f800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4f800b65a0 0x7f4f800b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800ba40 tx=0x7f4f88005cc0 comp rx=0 tx=0).stop 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 msgr2=0x7f4f9819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 0x7f4f9819c800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00d950 tx=0x7f4f8c00de10 comp rx=0 tx=0).stop 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 shutdown_connections 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4f800b65a0 0x7f4f800b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f98104070 0x7f4f9819d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f981036d0 0x7f4f9819c800 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 --2- 172.21.15.60:0/4012765165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98102640 0x7f4f9819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.148+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 >> 172.21.15.60:0/4012765165 conn(0x7f4f980fdfb0 msgr2=0x7f4f980ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.149+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 shutdown_connections 2024-09-21T07:34:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:16.149+0000 7f4f9ddf2640 1 -- 172.21.15.60:0/4012765165 wait complete. 2024-09-21T07:34:16.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:16 smithi060 ceph-mon[31244]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:16.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T07:34:17.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:16 smithi187 ceph-mon[34367]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:17.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:16 smithi123 ceph-mon[34166]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:17.133 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 -- 172.21.15.60:0/803653327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec104120 msgr2=0x7f30ec10aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/803653327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec104120 0x7f30ec10aac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009ca0 tx=0x7f30e402a950 comp rx=0 tx=0).stop 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 -- 172.21.15.60:0/803653327 shutdown_connections 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/803653327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec104120 0x7f30ec10aac0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/803653327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ec103780 0x7f30ec103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/803653327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec1026f0 0x7f30ec102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 -- 172.21.15.60:0/803653327 >> 172.21.15.60:0/803653327 conn(0x7f30ec0fe080 msgr2=0x7f30ec100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 -- 172.21.15.60:0/803653327 shutdown_connections 2024-09-21T07:34:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.567+0000 7f30f0f3c640 1 -- 172.21.15.60:0/803653327 wait complete. 2024-09-21T07:34:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 Processor -- start 2024-09-21T07:34:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 -- start start 2024-09-21T07:34:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 0x7f30ec06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec103780 0x7f30ec19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ec104120 0x7f30ec1a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10e2d0 con 0x7f30ec1026f0 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10e150 con 0x7f30ec104120 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30f0f3c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10e450 con 0x7f30ec103780 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30ea59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 0x7f30ec06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30ea59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 0x7f30ec06c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44328/0 (socket says 172.21.15.60:44328) 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.568+0000 7f30ea59c640 1 -- 172.21.15.60:0/650513139 learned_addr learned my addr 172.21.15.60:0/650513139 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30e9d9b640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec103780 0x7f30ec19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ea59c640 1 -- 172.21.15.60:0/650513139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec103780 msgr2=0x7f30ec19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ead9d640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ec104120 0x7f30ec1a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ea59c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec103780 0x7f30ec19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ea59c640 1 -- 172.21.15.60:0/650513139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ec104120 msgr2=0x7f30ec1a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ea59c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ec104120 0x7f30ec1a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ea59c640 1 -- 172.21.15.60:0/650513139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec1a1a30 con 0x7f30ec1026f0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30e9d9b640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec103780 0x7f30ec19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30ea59c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 0x7f30ec06c060 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00e9f0 tx=0x7f30dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc00cd80 con 0x7f30ec1026f0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec1a1d20 con 0x7f30ec1026f0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30dc0054d0 con 0x7f30ec1026f0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc010690 con 0x7f30ec1026f0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.569+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec1a21b0 con 0x7f30ec1026f0 2024-09-21T07:34:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.570+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ec1098d0 con 0x7f30ec1026f0 2024-09-21T07:34:17.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.572+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f30dc004e30 con 0x7f30ec1026f0 2024-09-21T07:34:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.573+0000 7f30db7fe640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f30d40b65a0 0x7f30d40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.573+0000 7f30e9d9b640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f30d40b65a0 0x7f30d40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.573+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f30dc0e7bc0 con 0x7f30ec1026f0 2024-09-21T07:34:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.574+0000 7f30e9d9b640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f30d40b65a0 0x7f30d40b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f30e00058c0 tx=0x7f30e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.577+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30dc056710 con 0x7f30ec1026f0 2024-09-21T07:34:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.774+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f30ec063800 con 0x7f30d40b65a0 2024-09-21T07:34:17.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.780+0000 7f30db7fe640 1 -- 172.21.15.60:0/650513139 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f30ec063800 con 0x7f30d40b65a0 2024-09-21T07:34:17.782 INFO:teuthology.orchestra.run.smithi060.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T07:34:17.782 INFO:teuthology.orchestra.run.smithi060.stdout:mds.all 12/12 27s ago 2m smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi123=b;smithi123=e;smithi123=h;smithi123=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2024-09-21T07:34:17.782 INFO:teuthology.orchestra.run.smithi060.stdout:mgr 3/3 27s ago 7m smithi060=x;smithi123=y;smithi187=z;count:3 2024-09-21T07:34:17.782 INFO:teuthology.orchestra.run.smithi060.stdout:mon 3/3 27s ago 8m smithi060:172.21.15.60=a;smithi123:172.21.15.123=b;smithi187:172.21.15.187=c;count:3 2024-09-21T07:34:17.782 INFO:teuthology.orchestra.run.smithi060.stdout:osd 12 27s ago - 2024-09-21T07:34:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.782+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f30d40b65a0 msgr2=0x7f30d40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.782+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f30d40b65a0 0x7f30d40b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f30e00058c0 tx=0x7f30e0005850 comp rx=0 tx=0).stop 2024-09-21T07:34:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.782+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 msgr2=0x7f30ec06c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.782+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 0x7f30ec06c060 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00e9f0 tx=0x7f30dc00edf0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 shutdown_connections 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f30d40b65a0 0x7f30d40b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ec104120 0x7f30ec1a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30ec103780 0x7f30ec19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 --2- 172.21.15.60:0/650513139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30ec1026f0 0x7f30ec06c060 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 >> 172.21.15.60:0/650513139 conn(0x7f30ec0fe080 msgr2=0x7f30ec106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 shutdown_connections 2024-09-21T07:34:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:17.783+0000 7f30f0f3c640 1 -- 172.21.15.60:0/650513139 wait complete. 2024-09-21T07:34:17.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:17 smithi060 ceph-mon[31244]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:18.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:17 smithi187 ceph-mon[34367]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:18.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:17 smithi123 ceph-mon[34166]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:18.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T07:34:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:19.000 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:18 smithi123 ceph-mon[34166]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:19.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:18 smithi187 ceph-mon[34367]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:19.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:18 smithi060 ceph-mon[31244]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 -- 172.21.15.60:0/3563314038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb790103720 msgr2=0x7fb790103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3563314038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb790103720 0x7fb790103b30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb780009900 tx=0x7fb78002a480 comp rx=0 tx=0).stop 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 -- 172.21.15.60:0/3563314038 shutdown_connections 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3563314038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7901040c0 0x7fb79010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3563314038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb790103720 0x7fb790103b30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3563314038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb790102690 0x7fb790102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 -- 172.21.15.60:0/3563314038 >> 172.21.15.60:0/3563314038 conn(0x7fb7900fe000 msgr2=0x7fb7901004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 -- 172.21.15.60:0/3563314038 shutdown_connections 2024-09-21T07:34:19.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.184+0000 7fb7986b1640 1 -- 172.21.15.60:0/3563314038 wait complete. 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 Processor -- start 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 -- start start 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb790102690 0x7fb79006c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:19.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb790103720 0x7fb79019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 0x7fb7901a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb79010e340 con 0x7fb7901040c0 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb79010e1c0 con 0x7fb790103720 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb7986b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb79010e4c0 con 0x7fb790102690 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb796c4e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 0x7fb7901a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb796c4e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 0x7fb7901a1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44360/0 (socket says 172.21.15.60:44360) 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb796c4e640 1 -- 172.21.15.60:0/3597872027 learned_addr learned my addr 172.21.15.60:0/3597872027 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb795c4c640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb790103720 0x7fb79019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.185+0000 7fb79644d640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb790102690 0x7fb79006c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb796c4e640 1 -- 172.21.15.60:0/3597872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb790102690 msgr2=0x7fb79006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb796c4e640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb790102690 0x7fb79006c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb796c4e640 1 -- 172.21.15.60:0/3597872027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb790103720 msgr2=0x7fb79019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb796c4e640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb790103720 0x7fb79019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb796c4e640 1 -- 172.21.15.60:0/3597872027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7901a1af0 con 0x7fb7901040c0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb796c4e640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 0x7fb7901a1380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b970 tx=0x7fb78800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788019070 con 0x7fb7901040c0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb788014440 con 0x7fb7901040c0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7901a1de0 con 0x7fb7901040c0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880075d0 con 0x7fb7901040c0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.186+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7901a22c0 con 0x7fb7901040c0 2024-09-21T07:34:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.187+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb790109870 con 0x7fb7901040c0 2024-09-21T07:34:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.189+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb78801c070 con 0x7fb7901040c0 2024-09-21T07:34:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.189+0000 7fb7877fe640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb77c0b65a0 0x7fb77c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.190+0000 7fb79644d640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb77c0b65a0 0x7fb77c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.190+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fb7880e6870 con 0x7fb7901040c0 2024-09-21T07:34:19.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.190+0000 7fb79644d640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb77c0b65a0 0x7fb77c0b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00abe0 tx=0x7fb78c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:19.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.194+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7880b13b0 con 0x7fb7901040c0 2024-09-21T07:34:19.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.388+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb790063800 con 0x7fb77c0b65a0 2024-09-21T07:34:19.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.390+0000 7fb7877fe640 1 -- 172.21.15.60:0/3597872027 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fb790063800 con 0x7fb77c0b65a0 2024-09-21T07:34:19.392 INFO:teuthology.orchestra.run.smithi060.stdout:HOST ADDR LABELS STATUS 2024-09-21T07:34:19.392 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 172.21.15.60 2024-09-21T07:34:19.392 INFO:teuthology.orchestra.run.smithi060.stdout:smithi123 172.21.15.123 2024-09-21T07:34:19.392 INFO:teuthology.orchestra.run.smithi060.stdout:smithi187 172.21.15.187 2024-09-21T07:34:19.392 INFO:teuthology.orchestra.run.smithi060.stdout:3 hosts in cluster 2024-09-21T07:34:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb77c0b65a0 msgr2=0x7fb77c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb77c0b65a0 0x7fb77c0b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00abe0 tx=0x7fb78c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 msgr2=0x7fb7901a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 0x7fb7901a1380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b970 tx=0x7fb78800bd70 comp rx=0 tx=0).stop 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 shutdown_connections 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb77c0b65a0 0x7fb77c0b8ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7901040c0 0x7fb7901a1380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb790103720 0x7fb79019ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 --2- 172.21.15.60:0/3597872027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb790102690 0x7fb79006c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 >> 172.21.15.60:0/3597872027 conn(0x7fb7900fe000 msgr2=0x7fb790106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 shutdown_connections 2024-09-21T07:34:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:19.392+0000 7fb7986b1640 1 -- 172.21.15.60:0/3597872027 wait complete. 2024-09-21T07:34:20.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:19 smithi187 ceph-mon[34367]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:20.038 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:19 smithi060 ceph-mon[31244]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:20.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T07:34:20.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:19 smithi123 ceph-mon[34166]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:20.331 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 -- 172.21.15.60:0/2108402754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b00103750 msgr2=0x7f2b00103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 --2- 172.21.15.60:0/2108402754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b00103750 0x7f2b00103bc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009900 tx=0x7f2ae802a480 comp rx=0 tx=0).stop 2024-09-21T07:34:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 -- 172.21.15.60:0/2108402754 shutdown_connections 2024-09-21T07:34:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 --2- 172.21.15.60:0/2108402754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00105180 0x7f2b0010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 --2- 172.21.15.60:0/2108402754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b001047e0 0x7f2b00104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 --2- 172.21.15.60:0/2108402754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b00103750 0x7f2b00103bc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 -- 172.21.15.60:0/2108402754 >> 172.21.15.60:0/2108402754 conn(0x7f2b000ff0c0 msgr2=0x7f2b00101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 -- 172.21.15.60:0/2108402754 shutdown_connections 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.808+0000 7f2b070d7640 1 -- 172.21.15.60:0/2108402754 wait complete. 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 Processor -- start 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 -- start start 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00103750 0x7f2b00199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 0x7f2b0019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b00105180 0x7f2b0019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0010f390 con 0x7f2b001047e0 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0010f210 con 0x7f2b00105180 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2b070d7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0010f510 con 0x7f2b00103750 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2afffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 0x7f2b0019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2afffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 0x7f2b0019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44386/0 (socket says 172.21.15.60:44386) 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.809+0000 7f2afffff640 1 -- 172.21.15.60:0/4169139442 learned_addr learned my addr 172.21.15.60:0/4169139442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2b05674640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b00105180 0x7f2b0019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2b04e73640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00103750 0x7f2b00199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afffff640 1 -- 172.21.15.60:0/4169139442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00103750 msgr2=0x7f2b00199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afffff640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00103750 0x7f2b00199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afffff640 1 -- 172.21.15.60:0/4169139442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b00105180 msgr2=0x7f2b0019b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afffff640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b00105180 0x7f2b0019b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afffff640 1 -- 172.21.15.60:0/4169139442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0019ba00 con 0x7f2b001047e0 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2b04e73640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00103750 0x7f2b00199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afffff640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 0x7f2b0019a640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2af000cce0 tx=0x7f2af000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0004b20 con 0x7f2b001047e0 2024-09-21T07:34:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2af0004cc0 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0019bcf0 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af000f6b0 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.810+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b001a23f0 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.812+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0010a930 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.813+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2af000f850 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.814+0000 7f2afdffb640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2aec0b65a0 0x7f2aec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.814+0000 7f2b04e73640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2aec0b65a0 0x7f2aec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.814+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f2af00e7520 con 0x7f2b001047e0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.814+0000 7f2b04e73640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2aec0b65a0 0x7f2aec0b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8005f70 tx=0x7f2ae8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:20.818+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2af0014030 con 0x7f2b001047e0 2024-09-21T07:34:21.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.016+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f2b00063800 con 0x7f2aec0b65a0 2024-09-21T07:34:21.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:20 smithi060 ceph-mon[31244]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:21.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:20 smithi187 ceph-mon[34367]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.018+0000 7f2afdffb640 1 -- 172.21.15.60:0/4169139442 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f2b00063800 con 0x7f2aec0b65a0 2024-09-21T07:34:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T07:34:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:34:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:34:21.020 INFO:teuthology.orchestra.run.smithi060.stdout:smithi187 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500MW400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:34:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.020+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2aec0b65a0 msgr2=0x7f2aec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.020+0000 7f2b070d7640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2aec0b65a0 0x7f2aec0b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8005f70 tx=0x7f2ae8000bc0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.020+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 msgr2=0x7f2b0019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.020+0000 7f2b070d7640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 0x7f2b0019a640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2af000cce0 tx=0x7f2af000a620 comp rx=0 tx=0).stop 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 shutdown_connections 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2aec0b65a0 0x7f2aec0b8ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b00105180 0x7f2b0019b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b001047e0 0x7f2b0019a640 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 --2- 172.21.15.60:0/4169139442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b00103750 0x7f2b00199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 >> 172.21.15.60:0/4169139442 conn(0x7f2b000ff0c0 msgr2=0x7f2b00107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 shutdown_connections 2024-09-21T07:34:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:21.021+0000 7f2b070d7640 1 -- 172.21.15.60:0/4169139442 wait complete. 2024-09-21T07:34:21.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:20 smithi123 ceph-mon[34166]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:21.821 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:21 smithi060 ceph-mon[31244]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:21.821 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:21 smithi060 ceph-mon[31244]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:21.854 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:34:21.862 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T07:34:21.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T07:34:22.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:21 smithi187 ceph-mon[34367]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:22.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:21 smithi187 ceph-mon[34367]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:21 smithi123 ceph-mon[34166]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:22.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:21 smithi123 ceph-mon[34166]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:22.125 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:22.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 -- 172.21.15.60:0/3014154735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18104800 msgr2=0x7faa18104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 --2- 172.21.15.60:0/3014154735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18104800 0x7faa18104c10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faa00009900 tx=0x7faa0002a480 comp rx=0 tx=0).stop 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 -- 172.21.15.60:0/3014154735 shutdown_connections 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 --2- 172.21.15.60:0/3014154735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa181051a0 0x7faa1810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 --2- 172.21.15.60:0/3014154735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18104800 0x7faa18104c10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 --2- 172.21.15.60:0/3014154735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa18103770 0x7faa18103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 -- 172.21.15.60:0/3014154735 >> 172.21.15.60:0/3014154735 conn(0x7faa180ff0e0 msgr2=0x7faa18101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 -- 172.21.15.60:0/3014154735 shutdown_connections 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.566+0000 7faa1e742640 1 -- 172.21.15.60:0/3014154735 wait complete. 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 Processor -- start 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 -- start start 2024-09-21T07:34:22.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 0x7faa1819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa18104800 0x7faa1819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa181051a0 0x7faa1819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810f420 con 0x7faa18103770 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810f2a0 con 0x7faa18104800 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa1e742640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810f5a0 con 0x7faa181051a0 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 0x7faa1819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 0x7faa1819a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44404/0 (socket says 172.21.15.60:44404) 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 -- 172.21.15.60:0/1423650041 learned_addr learned my addr 172.21.15.60:0/1423650041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa0ffff640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa18104800 0x7faa1819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 -- 172.21.15.60:0/1423650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa181051a0 msgr2=0x7faa1819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa181051a0 0x7faa1819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 -- 172.21.15.60:0/1423650041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa18104800 msgr2=0x7faa1819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.567+0000 7faa17fff640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa18104800 0x7faa1819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa17fff640 1 -- 172.21.15.60:0/1423650041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1819ba70 con 0x7faa18103770 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa17fff640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 0x7faa1819a040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa0800d950 tx=0x7faa0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08017070 con 0x7faa18103770 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa08009c30 con 0x7faa18103770 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0800f620 con 0x7faa18103770 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1819bd60 con 0x7faa18103770 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.568+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa181a2460 con 0x7faa18103770 2024-09-21T07:34:22.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.569+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1810a930 con 0x7faa18103770 2024-09-21T07:34:22.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.572+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faa08010460 con 0x7faa18103770 2024-09-21T07:34:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.572+0000 7faa15ffb640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faa040b6620 0x7faa040b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.573+0000 7faa0ffff640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faa040b6620 0x7faa040b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:22.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.573+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7faa080e7100 con 0x7faa18103770 2024-09-21T07:34:22.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.573+0000 7faa0ffff640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faa040b6620 0x7faa040b8b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa0002a9a0 tx=0x7faa00005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:22.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.576+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa080ad8e0 con 0x7faa18103770 2024-09-21T07:34:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.803+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7faa18063fc0 con 0x7faa18103770 2024-09-21T07:34:22.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.804+0000 7faa15ffb640 1 -- 172.21.15.60:0/1423650041 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3090 (secure 0 0 0) 0x7faa08009de0 con 0x7faa18103770 2024-09-21T07:34:22.805 INFO:teuthology.orchestra.run.smithi060.stdout:e24 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-21T07:33:05:373246+0000 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 24 2024-09-21T07:34:22.806 INFO:teuthology.orchestra.run.smithi060.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T07:32:53.917796+0000 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T07:33:05.146717+0000 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 300 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-21T07:34:22.807 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 3 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:in 0,1,2 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=24653,1=24623,2=24613} 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 0 2024-09-21T07:34:22.808 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 24653 members: 24613,24623,24653 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b{0:24653} state up:active seq 4 addr [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.e{0:24599} state up:standby-replay seq 1 addr [v2:172.21.15.123:6834/1302227504,v1:172.21.15.123:6835/1302227504] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.h{1:24623} state up:active seq 8 addr [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c{1:24598} state up:standby-replay seq 1 addr [v2:172.21.15.187:6836/4006232422,v1:172.21.15.187:6837/4006232422] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.i{2:24613} state up:active seq 8 addr [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.f{2:24586} state up:standby-replay seq 1 addr [v2:172.21.15.187:6834/1725714173,v1:172.21.15.187:6835/1725714173] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.j{-1:14709} state up:standby seq 1 addr [v2:172.21.15.60:6834/2104077895,v1:172.21.15.60:6835/2104077895] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d{-1:14721} state up:standby seq 1 addr [v2:172.21.15.60:6836/1000584713,v1:172.21.15.60:6837/1000584713] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.809 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.g{-1:14772} state up:standby seq 1 addr [v2:172.21.15.60:6838/349223669,v1:172.21.15.60:6839/349223669] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.810 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a{-1:14778} state up:standby seq 1 addr [v2:172.21.15.60:6840/2013963120,v1:172.21.15.60:6841/2013963120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.810 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.l{-1:24544} state up:standby seq 1 addr [v2:172.21.15.187:6832/147828917,v1:172.21.15.187:6833/147828917] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.810 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.k{-1:24575} state up:standby seq 1 addr [v2:172.21.15.123:6832/192831616,v1:172.21.15.123:6833/192831616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:34:22.810 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faa040b6620 msgr2=0x7faa040b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faa040b6620 0x7faa040b8b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa0002a9a0 tx=0x7faa00005fd0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 msgr2=0x7faa1819a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 0x7faa1819a040 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa0800d950 tx=0x7faa0800de10 comp rx=0 tx=0).stop 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 shutdown_connections 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faa040b6620 0x7faa040b8b30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa181051a0 0x7faa1819b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa18104800 0x7faa1819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 --2- 172.21.15.60:0/1423650041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa18103770 0x7faa1819a040 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 >> 172.21.15.60:0/1423650041 conn(0x7faa180ff0e0 msgr2=0x7faa18107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 shutdown_connections 2024-09-21T07:34:22.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:22.806+0000 7faa1e742640 1 -- 172.21.15.60:0/1423650041 wait complete. 2024-09-21T07:34:23.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T07:34:23.724 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:24.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:23 smithi187 ceph-mon[34367]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:24.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1423650041' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:34:24.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:23 smithi123 ceph-mon[34166]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:24.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1423650041' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:34:24.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:23 smithi060 ceph-mon[31244]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:24.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1423650041' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:34:24.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 -- 172.21.15.60:0/2017586623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab74077060 msgr2=0x7fab74075730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 --2- 172.21.15.60:0/2017586623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab74077060 0x7fab74075730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fab64009900 tx=0x7fab6402a410 comp rx=0 tx=0).stop 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 -- 172.21.15.60:0/2017586623 shutdown_connections 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 --2- 172.21.15.60:0/2017586623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab7410b790 0x7fab7410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 --2- 172.21.15.60:0/2017586623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab74075c70 0x7fab74076080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 --2- 172.21.15.60:0/2017586623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab74077060 0x7fab74075730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 -- 172.21.15.60:0/2017586623 >> 172.21.15.60:0/2017586623 conn(0x7fab740ff0c0 msgr2=0x7fab74101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 -- 172.21.15.60:0/2017586623 shutdown_connections 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 -- 172.21.15.60:0/2017586623 wait complete. 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 Processor -- start 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.317+0000 7fab79ffe640 1 -- start start 2024-09-21T07:34:24.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab74075c70 0x7fab7419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab74077060 0x7fab7419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 0x7fab7419d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fab74111600 con 0x7fab7410b790 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab74111480 con 0x7fab74075c70 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fab74111780 con 0x7fab74077060 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 0x7fab7419d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 0x7fab7419d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44422/0 (socket says 172.21.15.60:44422) 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 -- 172.21.15.60:0/35745931 learned_addr learned my addr 172.21.15.60:0/35745931 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab737fe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab74075c70 0x7fab7419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 -- 172.21.15.60:0/35745931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab74077060 msgr2=0x7fab7419c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab74077060 0x7fab7419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 -- 172.21.15.60:0/35745931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab74075c70 msgr2=0x7fab7419c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab74075c70 0x7fab7419c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 -- 172.21.15.60:0/35745931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7419dbd0 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab73fff640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 0x7fab7419d440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b970 tx=0x7fab6c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c019070 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab6c014440 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7419dec0 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.318+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c0075d0 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.319+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab741a4500 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.319+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7410a5a0 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.321+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fab6c01c070 con 0x7fab7410b790 2024-09-21T07:34:24.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.322+0000 7fab717fa640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fab600b65a0 0x7fab600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:24.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.322+0000 7fab737fe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fab600b65a0 0x7fab600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:24.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.322+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fab6c0e6e70 con 0x7fab7410b790 2024-09-21T07:34:24.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.323+0000 7fab737fe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fab600b65a0 0x7fab600b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab64031440 tx=0x7fab640314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:24.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.326+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab6c0ad5d0 con 0x7fab7410b790 2024-09-21T07:34:24.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.515+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fab7402e640 con 0x7fab7410b790 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.516+0000 7fab717fa640 1 -- 172.21.15.60:0/35745931 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v76) ==== 56+0+5250 (secure 0 0 0) 0x7fab6c0b19b0 con 0x7fab7410b790 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 76 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-21T07:24:36.496842+0000 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-21T07:33:33.924895+0000 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T07:34:24.518 INFO:teuthology.orchestra.run.smithi060.stdout:crush_version 26 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:full_ratio 0.95 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:backfillfull_ratio 0.9 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:nearfull_ratio 0.85 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:require_min_compat_client luminous 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:min_compat_client luminous 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:require_osd_release squid 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:stretch_mode_enabled false 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:max_osd 12 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 up in weight 1 up_from 8 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6802/331796551,v1:172.21.15.60:6803/331796551] [v2:172.21.15.60:6804/331796551,v1:172.21.15.60:6805/331796551] exists,up f3a719ec-ef8e-4f38-902e-2aec93ed6ed1 2024-09-21T07:34:24.519 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 up in weight 1 up_from 12 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6800/1737463834,v1:172.21.15.123:6801/1737463834] [v2:172.21.15.123:6802/1737463834,v1:172.21.15.123:6803/1737463834] exists,up a864067d-8d15-4d06-9ff5-0750ec06bd7b 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 up in weight 1 up_from 17 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/2554805440,v1:172.21.15.187:6801/2554805440] [v2:172.21.15.187:6802/2554805440,v1:172.21.15.187:6803/2554805440] exists,up 9eb477e9-1e45-45e6-9146-150a9a015d1c 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 up in weight 1 up_from 25 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6810/1306706740,v1:172.21.15.60:6811/1306706740] [v2:172.21.15.60:6812/1306706740,v1:172.21.15.60:6813/1306706740] exists,up 74305a81-d848-48b3-936b-ead6ec6cbad8 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 up in weight 1 up_from 30 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6808/3197471804,v1:172.21.15.123:6809/3197471804] [v2:172.21.15.123:6810/3197471804,v1:172.21.15.123:6811/3197471804] exists,up a7c4c148-9290-45d8-a044-058f80bf0492 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 up in weight 1 up_from 36 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6808/3494184660,v1:172.21.15.187:6809/3494184660] [v2:172.21.15.187:6810/3494184660,v1:172.21.15.187:6811/3494184660] exists,up 8498706f-736f-4998-b5e7-51c3d922e0b6 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 up in weight 1 up_from 41 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6818/3398529627,v1:172.21.15.60:6819/3398529627] [v2:172.21.15.60:6820/3398529627,v1:172.21.15.60:6821/3398529627] exists,up 6853e674-76d8-43c3-a656-f497be510006 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 up in weight 1 up_from 46 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6816/203595290,v1:172.21.15.123:6817/203595290] [v2:172.21.15.123:6818/203595290,v1:172.21.15.123:6819/203595290] exists,up 91b7b6ec-445e-4ac5-991a-4c83fc17703b 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 up in weight 1 up_from 52 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6816/2898656123,v1:172.21.15.187:6817/2898656123] [v2:172.21.15.187:6818/2898656123,v1:172.21.15.187:6819/2898656123] exists,up ccbf9802-3c77-410f-ad6e-b28906ed622e 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 up in weight 1 up_from 57 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6826/81256373,v1:172.21.15.60:6827/81256373] [v2:172.21.15.60:6828/81256373,v1:172.21.15.60:6829/81256373] exists,up aff3c884-5283-4516-877a-c4b25cccb08b 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 up in weight 1 up_from 62 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6824/771892497,v1:172.21.15.123:6825/771892497] [v2:172.21.15.123:6826/771892497,v1:172.21.15.123:6827/771892497] exists,up fd38d9d3-db87-467d-8eb8-30f7ef2d71ff 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 up in weight 1 up_from 68 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6824/2953073093,v1:172.21.15.187:6825/2953073093] [v2:172.21.15.187:6826/2953073093,v1:172.21.15.187:6827/2953073093] exists,up ebf88bac-fc34-49b0-b0ac-4a2ab1040524 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.5 [8,11] 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.10 [8,11] 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.14 [2,4] 2024-09-21T07:34:24.520 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.1b [2,4] 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.13 [4,9] 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.38 [3,9] 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/1385204668 expires 2024-09-22T07:25:32.507621+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6801/510621072 expires 2024-09-22T07:25:32.507621+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/2378675823 expires 2024-09-22T07:25:32.507621+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6800/3227569621 expires 2024-09-22T07:25:05.170700+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/920466350 expires 2024-09-22T07:25:32.507621+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6801/3227569621 expires 2024-09-22T07:25:05.170700+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/2951813751 expires 2024-09-22T07:25:05.170700+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/1994595675 expires 2024-09-22T07:25:05.170700+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6800/510621072 expires 2024-09-22T07:25:32.507621+0000 2024-09-21T07:34:24.521 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/3389403472 expires 2024-09-22T07:25:05.170700+0000 2024-09-21T07:34:24.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.519+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fab600b65a0 msgr2=0x7fab600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.519+0000 7fab79ffe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fab600b65a0 0x7fab600b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab64031440 tx=0x7fab640314a0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.519+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 msgr2=0x7fab7419d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:24.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.519+0000 7fab79ffe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 0x7fab7419d440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b970 tx=0x7fab6c00be30 comp rx=0 tx=0).stop 2024-09-21T07:34:24.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 shutdown_connections 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fab600b65a0 0x7fab600b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab7410b790 0x7fab7419d440 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab74077060 0x7fab7419c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 --2- 172.21.15.60:0/35745931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab74075c70 0x7fab7419c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 >> 172.21.15.60:0/35745931 conn(0x7fab740ff0c0 msgr2=0x7fab74107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 shutdown_connections 2024-09-21T07:34:24.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:24.520+0000 7fab79ffe640 1 -- 172.21.15.60:0/35745931 wait complete. 2024-09-21T07:34:24.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:24 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/35745931' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:34:25.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:24 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/35745931' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:34:25.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:24 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/35745931' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:34:25.192 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T07:34:25.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:34:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:25.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:25 smithi060 ceph-mon[31244]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:25.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.888+0000 7f5acdf4c640 1 -- 172.21.15.60:0/140450978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 msgr2=0x7f5ac8105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:25.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.888+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/140450978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac8105630 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5abc009900 tx=0x7f5abc02a410 comp rx=0 tx=0).stop 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.888+0000 7f5acdf4c640 1 -- 172.21.15.60:0/140450978 shutdown_connections 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.888+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/140450978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ac8105b70 0x7f5ac810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.888+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/140450978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac8105630 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.889+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/140450978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac8103250 0x7f5ac8103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.889+0000 7f5acdf4c640 1 -- 172.21.15.60:0/140450978 >> 172.21.15.60:0/140450978 conn(0x7f5ac8079ea0 msgr2=0x7f5ac807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.889+0000 7f5acdf4c640 1 -- 172.21.15.60:0/140450978 shutdown_connections 2024-09-21T07:34:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.889+0000 7f5acdf4c640 1 -- 172.21.15.60:0/140450978 wait complete. 2024-09-21T07:34:25.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.889+0000 7f5acdf4c640 1 Processor -- start 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 -- start start 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ac8103250 0x7f5ac819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac8105b70 0x7f5ac819fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8112a80 con 0x7f5ac8105220 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8112900 con 0x7f5ac8105b70 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5acdf4c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8112c00 con 0x7f5ac8103250 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac819ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44430/0 (socket says 172.21.15.60:44430) 2024-09-21T07:34:25.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 -- 172.21.15.60:0/3664188885 learned_addr learned my addr 172.21.15.60:0/3664188885 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac7fff640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac8105b70 0x7f5ac819fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac77fe640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ac8103250 0x7f5ac819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 -- 172.21.15.60:0/3664188885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ac8103250 msgr2=0x7f5ac819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ac8103250 0x7f5ac819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 -- 172.21.15.60:0/3664188885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac8105b70 msgr2=0x7f5ac819fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac8105b70 0x7f5ac819fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.890+0000 7f5ac6ffd640 1 -- 172.21.15.60:0/3664188885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac81a05f0 con 0x7f5ac8105220 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.891+0000 7f5ac6ffd640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac819ac20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5abc005940 tx=0x7f5abc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.891+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc03f030 con 0x7f5ac8105220 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.891+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5abc003cb0 con 0x7f5ac8105220 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.891+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81a0880 con 0x7f5ac8105220 2024-09-21T07:34:25.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.891+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc035070 con 0x7f5ac8105220 2024-09-21T07:34:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.891+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac81a7040 con 0x7f5ac8105220 2024-09-21T07:34:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.892+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac8103660 con 0x7f5ac8105220 2024-09-21T07:34:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.893+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5abc042030 con 0x7f5ac8105220 2024-09-21T07:34:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.894+0000 7f5ac4ff9640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5ab00b6620 0x7f5ab00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.894+0000 7f5ac77fe640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5ab00b6620 0x7f5ab00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.894+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f5abc107b20 con 0x7f5ac8105220 2024-09-21T07:34:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.895+0000 7f5ac77fe640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5ab00b6620 0x7f5ab00b8b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ac806bb90 tx=0x7f5ab800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:25.898+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5abc0d2600 con 0x7f5ac8105220 2024-09-21T07:34:26.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:25 smithi187 ceph-mon[34367]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:26.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:25 smithi123 ceph-mon[34166]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:26.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.124+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ac81a7210 con 0x7f5ac8105220 2024-09-21T07:34:26.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.125+0000 7f5ac4ff9640 1 -- 172.21.15.60:0/3664188885 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f5abc0d7540 con 0x7f5ac8105220 2024-09-21T07:34:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:26.127 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T07:33:05:373246+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:33:05.146717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24613,24623,24653]},"id":1}]} 2024-09-21T07:34:26.127 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:34:26.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.127+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5ab00b6620 msgr2=0x7f5ab00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:26.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.127+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5ab00b6620 0x7f5ab00b8b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ac806bb90 tx=0x7f5ab800b390 comp rx=0 tx=0).stop 2024-09-21T07:34:26.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.127+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 msgr2=0x7f5ac819ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:26.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.127+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac819ac20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5abc005940 tx=0x7f5abc0042f0 comp rx=0 tx=0).stop 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.127+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 shutdown_connections 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.127+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f5ab00b6620 0x7f5ab00b8b30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.128+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ac8105b70 0x7f5ac819fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.128+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ac8105220 0x7f5ac819ac20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.128+0000 7f5acdf4c640 1 --2- 172.21.15.60:0/3664188885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ac8103250 0x7f5ac819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.128+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 >> 172.21.15.60:0/3664188885 conn(0x7f5ac8079ea0 msgr2=0x7f5ac81011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.128+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 shutdown_connections 2024-09-21T07:34:26.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:26.128+0000 7f5acdf4c640 1 -- 172.21.15.60:0/3664188885 wait complete. 2024-09-21T07:34:26.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:34:26.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:26 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3664188885' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:27.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:26 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3664188885' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:27.046 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:27.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:26 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3664188885' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.521+0000 7fd013cfb640 1 -- 172.21.15.60:0/3060196271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c109df0 msgr2=0x7fd00c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.521+0000 7fd013cfb640 1 --2- 172.21.15.60:0/3060196271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c109df0 0x7fd00c110620 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd004009ca0 tx=0x7fd00402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.521+0000 7fd013cfb640 1 -- 172.21.15.60:0/3060196271 shutdown_connections 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.521+0000 7fd013cfb640 1 --2- 172.21.15.60:0/3060196271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c109df0 0x7fd00c110620 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.521+0000 7fd013cfb640 1 --2- 172.21.15.60:0/3060196271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd00c1094a0 0x7fd00c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.522+0000 7fd013cfb640 1 --2- 172.21.15.60:0/3060196271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c103b60 0x7fd00c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.522+0000 7fd013cfb640 1 -- 172.21.15.60:0/3060196271 >> 172.21.15.60:0/3060196271 conn(0x7fd00c07b850 msgr2=0x7fd00c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.522+0000 7fd013cfb640 1 -- 172.21.15.60:0/3060196271 shutdown_connections 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.522+0000 7fd013cfb640 1 -- 172.21.15.60:0/3060196271 wait complete. 2024-09-21T07:34:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 Processor -- start 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 -- start start 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 0x7fd00c19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd00c1094a0 0x7fd00c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c109df0 0x7fd00c1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c113ab0 con 0x7fd00c103b60 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c113930 con 0x7fd00c1094a0 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd013cfb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c113c30 con 0x7fd00c109df0 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 0x7fd00c19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 0x7fd00c19c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60050/0 (socket says 172.21.15.60:60050) 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 -- 172.21.15.60:0/2281010437 learned_addr learned my addr 172.21.15.60:0/2281010437 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011296640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd00c1094a0 0x7fd00c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd012298640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c109df0 0x7fd00c1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 -- 172.21.15.60:0/2281010437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c109df0 msgr2=0x7fd00c1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c109df0 0x7fd00c1a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 -- 172.21.15.60:0/2281010437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd00c1094a0 msgr2=0x7fd00c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd00c1094a0 0x7fd00c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.523+0000 7fd011a97640 1 -- 172.21.15.60:0/2281010437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c1a2630 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.524+0000 7fd011a97640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 0x7fd00c19c6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd00800d770 tx=0x7fd00800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.524+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008017070 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.524+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0080054d0 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.524+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c1a2920 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.524+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008004c30 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.524+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c1a9080 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.525+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c103f70 con 0x7fd00c103b60 2024-09-21T07:34:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.527+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd008004dd0 con 0x7fd00c103b60 2024-09-21T07:34:27.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.527+0000 7fd002ffd640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcff80b65a0 0x7fcff80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:27.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.528+0000 7fd011296640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcff80b65a0 0x7fcff80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:27.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.528+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fd0080e7260 con 0x7fd00c103b60 2024-09-21T07:34:27.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.528+0000 7fd011296640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcff80b65a0 0x7fcff80b8ab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd00c106e70 tx=0x7fcffc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:27.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.531+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0080b1da0 con 0x7fd00c103b60 2024-09-21T07:34:27.754 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:27 smithi060 ceph-mon[31244]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:27.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.759+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd00c1a92e0 con 0x7fd00c103b60 2024-09-21T07:34:27.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.759+0000 7fd002ffd640 1 -- 172.21.15.60:0/2281010437 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fd0080b6ce0 con 0x7fd00c103b60 2024-09-21T07:34:27.761 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:27.761 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"btime":"2024-09-21T07:33:05:373246+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:33:05.146717+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24613,24623,24653]},"id":1}]} 2024-09-21T07:34:27.762 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcff80b65a0 msgr2=0x7fcff80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcff80b65a0 0x7fcff80b8ab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd00c106e70 tx=0x7fcffc00b390 comp rx=0 tx=0).stop 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 msgr2=0x7fd00c19c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 0x7fd00c19c6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd00800d770 tx=0x7fd00800dc30 comp rx=0 tx=0).stop 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 shutdown_connections 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fcff80b65a0 0x7fcff80b8ab0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd00c109df0 0x7fd00c1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd00c1094a0 0x7fd00c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 --2- 172.21.15.60:0/2281010437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd00c103b60 0x7fd00c19c6c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 >> 172.21.15.60:0/2281010437 conn(0x7fd00c07b850 msgr2=0x7fd00c105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 shutdown_connections 2024-09-21T07:34:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:27.762+0000 7fd013cfb640 1 -- 172.21.15.60:0/2281010437 wait complete. 2024-09-21T07:34:28.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:27 smithi187 ceph-mon[34367]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:28.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:27 smithi123 ceph-mon[34166]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:34:28.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:34:28.627 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:28.908 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:28 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2281010437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:29.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:28 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2281010437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:29.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:28 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2281010437' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:34:29.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.122+0000 7f133925e640 1 -- 172.21.15.60:0/1437978743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1334106bf0 msgr2=0x7f1334110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:29.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.122+0000 7f133925e640 1 --2- 172.21.15.60:0/1437978743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1334106bf0 0x7f1334110660 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f132c009ca0 tx=0x7f132c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 -- 172.21.15.60:0/1437978743 shutdown_connections 2024-09-21T07:34:29.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 --2- 172.21.15.60:0/1437978743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1334106bf0 0x7f1334110660 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 --2- 172.21.15.60:0/1437978743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13341062a0 0x7f13341066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 --2- 172.21.15.60:0/1437978743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1334102050 0x7f1334102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 -- 172.21.15.60:0/1437978743 >> 172.21.15.60:0/1437978743 conn(0x7f1334077c60 msgr2=0x7f13340780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:29.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 -- 172.21.15.60:0/1437978743 shutdown_connections 2024-09-21T07:34:29.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.123+0000 7f133925e640 1 -- 172.21.15.60:0/1437978743 wait complete. 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 Processor -- start 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 -- start start 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1334102050 0x7f1334102ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 0x7f1334103530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1334106bf0 0x7f1334103a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1334113aa0 con 0x7f13341062a0 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1334113920 con 0x7f1334106bf0 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133925e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f1334113c20 con 0x7f1334102050 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 0x7f1334103530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 0x7f1334103530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60066/0 (socket says 172.21.15.60:60066) 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.124+0000 7f133259c640 1 -- 172.21.15.60:0/3990176365 learned_addr learned my addr 172.21.15.60:0/3990176365 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:29.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133359e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1334106bf0 0x7f1334103a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f1332d9d640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1334102050 0x7f1334102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133259c640 1 -- 172.21.15.60:0/3990176365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1334102050 msgr2=0x7f1334102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133259c640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1334102050 0x7f1334102ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133259c640 1 -- 172.21.15.60:0/3990176365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1334106bf0 msgr2=0x7f1334103a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133259c640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1334106bf0 0x7f1334103a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133259c640 1 -- 172.21.15.60:0/3990176365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13341a85a0 con 0x7f13341062a0 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133259c640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 0x7f1334103530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f132400c8c0 tx=0x7f132400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324007bb0 con 0x7f13341062a0 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13341a8890 con 0x7f13341062a0 2024-09-21T07:34:29.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1324007d50 con 0x7f13341062a0 2024-09-21T07:34:29.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.125+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13240187c0 con 0x7f13341062a0 2024-09-21T07:34:29.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.126+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13341a8dd0 con 0x7f13341062a0 2024-09-21T07:34:29.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.127+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1334102460 con 0x7f13341062a0 2024-09-21T07:34:29.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.128+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f132400fa20 con 0x7f13341062a0 2024-09-21T07:34:29.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.129+0000 7f132bfff640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f13200b65a0 0x7f13200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:29.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.129+0000 7f1332d9d640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f13200b65a0 0x7f13200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:29.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.129+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f13240e7800 con 0x7f13341062a0 2024-09-21T07:34:29.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.130+0000 7f1332d9d640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f13200b65a0 0x7f13200b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1334104a40 tx=0x7f131c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:29.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.137+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1324014030 con 0x7f13341062a0 2024-09-21T07:34:29.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.327+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13341042f0 con 0x7f13341062a0 2024-09-21T07:34:29.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.330+0000 7f132bfff640 1 -- 172.21.15.60:0/3990176365 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22654 (secure 0 0 0) 0x7f13240adf90 con 0x7f13341062a0 2024-09-21T07:34:29.332 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:34:29.332 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:33:33.924895+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:34:29.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f13200b65a0 msgr2=0x7f13200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:29.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f13200b65a0 0x7f13200b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1334104a40 tx=0x7f131c005f90 comp rx=0 tx=0).stop 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 msgr2=0x7f1334103530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 0x7f1334103530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f132400c8c0 tx=0x7f132400cd80 comp rx=0 tx=0).stop 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 shutdown_connections 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f13200b65a0 0x7f13200b8ab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1334106bf0 0x7f1334103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13341062a0 0x7f1334103530 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 --2- 172.21.15.60:0/3990176365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1334102050 0x7f1334102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:29.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 >> 172.21.15.60:0/3990176365 conn(0x7f1334077c60 msgr2=0x7f1334105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 shutdown_connections 2024-09-21T07:34:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:29.333+0000 7f133925e640 1 -- 172.21.15.60:0/3990176365 wait complete. 2024-09-21T07:34:29.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:29 smithi060 ceph-mon[31244]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:29.918 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:29 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3990176365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:34:29.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:32:53.917796+0000', 'modified': '2024-09-21T07:33:05.146717+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24653, 'mds_1': 24623, 'mds_2': 24613}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24586': {'gid': 24586, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.187:6835/1725714173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 1725714173}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 1725714173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24598': {'gid': 24598, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.187:6837/4006232422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 4006232422}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 4006232422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/1302227504', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 1302227504}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1302227504}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.187:6839/1132397222', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 1132397222}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 1132397222}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24623': {'gid': 24623, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.123:6837/2557983020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6836', 'nonce': 2557983020}, {'type': 'v1', 'addr': '172.21.15.123:6837', 'nonce': 2557983020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6839/4279563434', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 4279563434}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 4279563434}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24613, 24623, 24653]} 2024-09-21T07:34:29.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T07:34:29.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:34:30.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:29 smithi187 ceph-mon[34367]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:30.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:29 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3990176365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:34:30.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:29 smithi123 ceph-mon[34166]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:34:30.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:29 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3990176365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:34:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 -- 172.21.15.60:0/519543705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 msgr2=0x7f036c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 --2- 172.21.15.60:0/519543705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c1087d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0360009ca0 tx=0x7f036002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 -- 172.21.15.60:0/519543705 shutdown_connections 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 --2- 172.21.15.60:0/519543705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c108d10 0x7f036c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 --2- 172.21.15.60:0/519543705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c1087d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 --2- 172.21.15.60:0/519543705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036c102a80 0x7f036c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 -- 172.21.15.60:0/519543705 >> 172.21.15.60:0/519543705 conn(0x7f036c079740 msgr2=0x7f036c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 -- 172.21.15.60:0/519543705 shutdown_connections 2024-09-21T07:34:30.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.646+0000 7f0371a13640 1 -- 172.21.15.60:0/519543705 wait complete. 2024-09-21T07:34:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.647+0000 7f0371a13640 1 Processor -- start 2024-09-21T07:34:30.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.647+0000 7f0371a13640 1 -- start start 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f0371a13640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c102a80 0x7f036c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f0371a13640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f0371a13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036c108d10 0x7f036c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f0371a13640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f036c112980 con 0x7f036c1083c0 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f0371a13640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f036c112800 con 0x7f036c108d10 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f0371a13640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f036c112b00 con 0x7f036c102a80 2024-09-21T07:34:30.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60080/0 (socket says 172.21.15.60:60080) 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 -- 172.21.15.60:0/3839823412 learned_addr learned my addr 172.21.15.60:0/3839823412 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036b7fe640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036c108d10 0x7f036c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036affd640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c102a80 0x7f036c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 -- 172.21.15.60:0/3839823412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c102a80 msgr2=0x7f036c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c102a80 0x7f036c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 -- 172.21.15.60:0/3839823412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036c108d10 msgr2=0x7f036c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036c108d10 0x7f036c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 -- 172.21.15.60:0/3839823412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c19f300 con 0x7f036c1083c0 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036affd640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c102a80 0x7f036c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.648+0000 7f036a7fc640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c199930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0360006010 tx=0x7f03600319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.649+0000 7f0370a11640 1 -- 172.21.15.60:0/3839823412 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360003bf0 con 0x7f036c1083c0 2024-09-21T07:34:30.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.649+0000 7f0370a11640 1 -- 172.21.15.60:0/3839823412 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0360003d90 con 0x7f036c1083c0 2024-09-21T07:34:30.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.649+0000 7f0370a11640 1 -- 172.21.15.60:0/3839823412 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036002fb60 con 0x7f036c1083c0 2024-09-21T07:34:30.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.649+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036c19f590 con 0x7f036c1083c0 2024-09-21T07:34:30.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.649+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036c1a5d50 con 0x7f036c1083c0 2024-09-21T07:34:30.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.651+0000 7f0377f87740 1 Processor -- start 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.651+0000 7f0377f87740 1 -- start start 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0370a11640 1 -- 172.21.15.60:0/3839823412 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f036002fd00 con 0x7f036c1083c0 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0377f87740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 0x55d96dabaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0377f87740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dabb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0377f87740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dabb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0377f87740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d96da32c10 con 0x55d96d714f60 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0377f87740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d96da22040 con 0x55d96d6f4280 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f0377f87740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55d96da25e50 con 0x55d96d6ec0a0 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 0x55d96dabaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 0x55d96dabaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60094/0 (socket says 172.21.15.60:60094) 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 -- 172.21.15.60:0/255972462 learned_addr learned my addr 172.21.15.60:0/255972462 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036affd640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dabb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036a7fc640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dabb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 -- 172.21.15.60:0/255972462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 msgr2=0x55d96dabb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dabb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 -- 172.21.15.60:0/255972462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 msgr2=0x55d96dabb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dabb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036b7fe640 1 -- 172.21.15.60:0/255972462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96d780540 con 0x55d96d714f60 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036affd640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dabb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.652+0000 7f036a7fc640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dabb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f036b7fe640 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 0x55d96dabaf00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0364011d70 tx=0x7f036400a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cef69df006268da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f0370a11640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03540b65a0 0x7f03540b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f0351ffb640 1 -- 172.21.15.60:0/255972462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036401f070 con 0x55d96d714f60 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f0351ffb640 1 -- 172.21.15.60:0/255972462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f036400c9f0 con 0x55d96d714f60 2024-09-21T07:34:30.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f036affd640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03540b65a0 0x7f03540b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f0351ffb640 1 -- 172.21.15.60:0/255972462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036401a9e0 con 0x55d96d714f60 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.653+0000 7f0370a11640 1 -- 172.21.15.60:0/3839823412 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f03601087c0 con 0x7f036c1083c0 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 -- 172.21.15.60:0/255972462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 msgr2=0x55d96dabaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 0x55d96dabaf00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0364011d70 tx=0x7f036400a8b0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f036affd640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03540b65a0 0x7f03540b8ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f035c0058c0 tx=0x7f035c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 -- 172.21.15.60:0/255972462 shutdown_connections 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dabb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dabb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 --2- 172.21.15.60:0/255972462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d714f60 0x55d96dabaf00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 -- 172.21.15.60:0/255972462 >> 172.21.15.60:0/255972462 conn(0x55d96d709350 msgr2=0x55d96dab8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 -- 172.21.15.60:0/255972462 shutdown_connections 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 -- 172.21.15.60:0/255972462 wait complete. 2024-09-21T07:34:30.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.654+0000 7f0377f87740 1 -- start start 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 Processor -- start 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 0x55d96dac6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dac7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d714f60 0x55d96dacc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d96d8835f0 con 0x55d96d6ec0a0 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d96d9bd010 con 0x55d96d6f4280 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55d96dac1470 con 0x55d96d714f60 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f0377f87740 10 client.0 _ll_register_callbacks cb 0x55d96da1c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 0x55d96dac6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 0x55d96dac6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60098/0 (socket says 172.21.15.60:60098) 2024-09-21T07:34:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 -- 172.21.15.60:0/2386617246 learned_addr learned my addr 172.21.15.60:0/2386617246 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036a7fc640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dac7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036b7fe640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d714f60 0x55d96dacc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 -- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d714f60 msgr2=0x55d96dacc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d714f60 0x55d96dacc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 -- 172.21.15.60:0/2386617246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 msgr2=0x55d96dac7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dac7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.655+0000 7f036affd640 1 -- 172.21.15.60:0/2386617246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96d9eaa00 con 0x55d96d6ec0a0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f036affd640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 0x55d96dac6ec0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f035c0127a0 tx=0x7f035c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cf3617d69756be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f034affd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f034affd640 1 -- 172.21.15.60:0/2386617246 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c004220 con 0x55d96d6ec0a0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f034affd640 1 -- 172.21.15.60:0/2386617246 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f035c0043c0 con 0x55d96d6ec0a0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f036400c9f0 con 0x55d96d6ec0a0 2024-09-21T07:34:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f034affd640 1 -- 172.21.15.60:0/2386617246 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f035c00f8d0 con 0x55d96d6ec0a0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f0377f87740 10 client.15258 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d96dad5510 con 0x55d96d6ec0a0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f034affd640 1 -- 172.21.15.60:0/2386617246 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f036400c9f0 con 0x55d96d6ec0a0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f034affd640 1 -- 172.21.15.60:0/2386617246 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f035c01f420 con 0x55d96d6ec0a0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.656+0000 7f0377f87740 10 client.15258 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f0377f87740 10 client.15258 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f0377f87740 20 client.15258 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f0377f87740 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d6d38e0 0x55d96dad8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f0377f87740 4 client.15258 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 --> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d96da34b60 con 0x55d96d6d38e0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f036a7fc640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d6d38e0 0x55d96dad8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f036a7fc640 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d6d38e0 0x55d96dad8ff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7fdd50d83659f37c server_cookie=e3786f0061a0d176 in_seq=0 out_seq=0 2024-09-21T07:34:30.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.657+0000 7f034affd640 10 client.15258 ms_handle_connect on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f034affd640 1 -- 172.21.15.60:0/2386617246 <== mds.2 v2:172.21.15.187:6838/1132397222 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d96da34b60 con 0x55d96d6d38e0 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f034affd640 10 client.15258 handle_command_reply: tid=0 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 client.15258 shutdown 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 msgr2=0x55d96dac6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 0x55d96dac6ec0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f035c0127a0 tx=0x7f035c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 shutdown_connections 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d6d38e0 0x55d96dad8ff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f034affd640 0 client.15258 ms_handle_reset on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d714f60 0x55d96dacc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dac7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 --2- 172.21.15.60:0/2386617246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6ec0a0 0x55d96dac6ec0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 >> 172.21.15.60:0/2386617246 conn(0x55d96d709350 msgr2=0x55d96dabc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 shutdown_connections 2024-09-21T07:34:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.658+0000 7f0377f87740 1 -- 172.21.15.60:0/2386617246 wait complete. 2024-09-21T07:34:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.659+0000 7f0377f87740 20 client.15258 trim_cache size 0 max 16384 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 Processor -- start 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 -- start start 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dab3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6ec0a0 0x55d96dac1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6f4280 0x55d96dac2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d96dad7330 con 0x55d96d6d38e0 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d96dad7a00 con 0x55d96d6ec0a0 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f0377f87740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55d96dad80d0 con 0x55d96d6f4280 2024-09-21T07:34:30.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dab3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dab3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60112/0 (socket says 172.21.15.60:60112) 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 -- 172.21.15.60:0/1211180035 learned_addr learned my addr 172.21.15.60:0/1211180035 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036a7fc640 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6ec0a0 0x55d96dac1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 -- 172.21.15.60:0/1211180035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6f4280 msgr2=0x55d96dac2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6f4280 0x55d96dac2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 -- 172.21.15.60:0/1211180035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6ec0a0 msgr2=0x55d96dac1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6ec0a0 0x55d96dac1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036affd640 1 -- 172.21.15.60:0/1211180035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96dabdd20 con 0x55d96d6d38e0 2024-09-21T07:34:30.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.677+0000 7f036a7fc640 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6ec0a0 0x55d96dac1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:30.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.678+0000 7f036affd640 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dab3ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f035c01f860 tx=0x7f035c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39583854b87c86e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.678+0000 7f03517fa640 1 -- 172.21.15.60:0/1211180035 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c01fad0 con 0x55d96d6d38e0 2024-09-21T07:34:30.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.678+0000 7f03517fa640 1 -- 172.21.15.60:0/1211180035 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f035c01fc70 con 0x55d96d6d38e0 2024-09-21T07:34:30.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.678+0000 7f03517fa640 1 -- 172.21.15.60:0/1211180035 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c004730 con 0x55d96d6d38e0 2024-09-21T07:34:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 -- 172.21.15.60:0/1211180035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 msgr2=0x55d96dab3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dab3ad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f035c01f860 tx=0x7f035c00bf50 comp rx=0 tx=0).stop 2024-09-21T07:34:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 -- 172.21.15.60:0/1211180035 shutdown_connections 2024-09-21T07:34:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6f4280 0x55d96dac2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6ec0a0 0x55d96dac1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 --2- 172.21.15.60:0/1211180035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dab3ad0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 -- 172.21.15.60:0/1211180035 >> 172.21.15.60:0/1211180035 conn(0x55d96d709350 msgr2=0x55d96dad69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 -- 172.21.15.60:0/1211180035 shutdown_connections 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 -- 172.21.15.60:0/1211180035 wait complete. 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 -- start start 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.679+0000 7f0377f87740 1 Processor -- start 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dacd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dacd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dad22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d96dad8e70 con 0x55d96d6d38e0 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d96dad87a0 con 0x55d96d6f4280 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x55d96dad9540 con 0x55d96d6ec0a0 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f0377f87740 10 client.0 _ll_register_callbacks cb 0x7f035c00ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dacd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dacd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60116/0 (socket says 172.21.15.60:60116) 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 -- 172.21.15.60:0/152806310 learned_addr learned my addr 172.21.15.60:0/152806310 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036a7fc640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dacd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036b7fe640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dad22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 -- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 msgr2=0x55d96dacd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dacd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 -- 172.21.15.60:0/152806310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 msgr2=0x55d96dad22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dad22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 -- 172.21.15.60:0/152806310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96dacdfa0 con 0x55d96d6d38e0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036a7fc640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dacd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f036affd640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dacd250 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f035c0127a0 tx=0x7f035c01f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e927d8fec99aeb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.680+0000 7f034affd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f034affd640 1 -- 172.21.15.60:0/152806310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c042070 con 0x55d96d6d38e0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f034affd640 1 -- 172.21.15.60:0/152806310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f035c0053d0 con 0x55d96d6d38e0 2024-09-21T07:34:30.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f035c01fc70 con 0x55d96d6d38e0 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f034affd640 1 -- 172.21.15.60:0/152806310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f035c04e050 con 0x55d96d6d38e0 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 10 client.15264 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d96dad3790 con 0x55d96d6d38e0 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f034affd640 1 -- 172.21.15.60:0/152806310 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f035c01fc70 con 0x55d96d6d38e0 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f034affd640 1 -- 172.21.15.60:0/152806310 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f035c047560 con 0x55d96d6d38e0 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 10 client.15264 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 10 client.15264 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 20 client.15264 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d714f60 0x55d96db47750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 4 client.15264 mds_command: new command op to 24613 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.681+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 --> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] -- command(tid 0: {"prefix": "status"}) -- 0x55d96da30610 con 0x55d96d714f60 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f036a7fc640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d714f60 0x55d96db47750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:30.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f036a7fc640 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d714f60 0x55d96db47750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2172556b2cec1f5 server_cookie=d47d0a426868692c in_seq=0 out_seq=0 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f034affd640 10 client.15264 ms_handle_connect on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f034affd640 1 -- 172.21.15.60:0/152806310 <== mds.2 v2:172.21.15.187:6838/1132397222 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d96da30610 con 0x55d96d714f60 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f034affd640 10 client.15264 handle_command_reply: tid=0 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 client.15264 shutdown 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 msgr2=0x55d96dacd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dacd250 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f035c0127a0 tx=0x7f035c01f570 comp rx=0 tx=0).stop 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 shutdown_connections 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:6838/1132397222,v1:172.21.15.187:6839/1132397222] conn(0x55d96d714f60 0x55d96db47750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d96d6f4280 0x55d96dad22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d96d6ec0a0 0x55d96dacd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 --2- 172.21.15.60:0/152806310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d96d6d38e0 0x55d96dacd250 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f034affd640 0 client.15264 ms_handle_reset on v2:172.21.15.187:6838/1132397222 2024-09-21T07:34:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.682+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 >> 172.21.15.60:0/152806310 conn(0x55d96d709350 msgr2=0x55d96dabffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 shutdown_connections 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0377f87740 1 -- 172.21.15.60:0/152806310 wait complete. 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0377f87740 20 client.15264 trim_cache size 0 max 16384 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24613, 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-21T07:34:30.691 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 88.315722523000005, 2024-09-21T07:34:30.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 24, 2024-09-21T07:34:30.692 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 76, 2024-09-21T07:34:30.692 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T07:34:30.692 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 114.696864545 2024-09-21T07:34:30.692 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:34:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03540b65a0 msgr2=0x7f03540b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03540b65a0 0x7f03540b8ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f035c0058c0 tx=0x7f035c005850 comp rx=0 tx=0).stop 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 msgr2=0x7f036c199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c199930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0360006010 tx=0x7f03600319f0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 shutdown_connections 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f03540b65a0 0x7f03540b8ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f036c108d10 0x7f036c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f036c1083c0 0x7f036c199930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 --2- 172.21.15.60:0/3839823412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f036c102a80 0x7f036c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 >> 172.21.15.60:0/3839823412 conn(0x7f036c079740 msgr2=0x7f036c104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.683+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 shutdown_connections 2024-09-21T07:34:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:30.684+0000 7f0371a13640 1 -- 172.21.15.60:0/3839823412 wait complete. 2024-09-21T07:34:31.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:34:31.652 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:32.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:31 smithi187 ceph-mon[34367]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:32.064 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:31 smithi060 ceph-mon[31244]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:32.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:31 smithi123 ceph-mon[34166]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 -- 172.21.15.60:0/4007431383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 msgr2=0x7f58e010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 --2- 172.21.15.60:0/4007431383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e010d850 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009900 tx=0x7f58d402a410 comp rx=0 tx=0).stop 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 -- 172.21.15.60:0/4007431383 shutdown_connections 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 --2- 172.21.15.60:0/4007431383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e010de10 0x7f58e0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 --2- 172.21.15.60:0/4007431383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e010d850 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 --2- 172.21.15.60:0/4007431383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e01049b0 0x7f58e0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 -- 172.21.15.60:0/4007431383 >> 172.21.15.60:0/4007431383 conn(0x7f58e0079730 msgr2=0x7f58e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 -- 172.21.15.60:0/4007431383 shutdown_connections 2024-09-21T07:34:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.155+0000 7f58e69cb640 1 -- 172.21.15.60:0/4007431383 wait complete. 2024-09-21T07:34:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 Processor -- start 2024-09-21T07:34:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 -- start start 2024-09-21T07:34:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01049b0 0x7f58e019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e010de10 0x7f58e019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0113b50 con 0x7f58e0105300 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58e01139d0 con 0x7f58e01049b0 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58e69cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0113cd0 con 0x7f58e010de10 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60128/0 (socket says 172.21.15.60:60128) 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.156+0000 7f58df7fe640 1 -- 172.21.15.60:0/556066712 learned_addr learned my addr 172.21.15.60:0/556066712 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58dffff640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01049b0 0x7f58e019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58e4f68640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e010de10 0x7f58e019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58df7fe640 1 -- 172.21.15.60:0/556066712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e010de10 msgr2=0x7f58e019fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58df7fe640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e010de10 0x7f58e019fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58df7fe640 1 -- 172.21.15.60:0/556066712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01049b0 msgr2=0x7f58e019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58df7fe640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01049b0 0x7f58e019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58df7fe640 1 -- 172.21.15.60:0/556066712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e01a05d0 con 0x7f58e0105300 2024-09-21T07:34:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58df7fe640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e019ac00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f58d402a930 tx=0x7f58d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58dd7fa640 1 -- 172.21.15.60:0/556066712 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d403f030 con 0x7f58e0105300 2024-09-21T07:34:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e01a0860 con 0x7f58e0105300 2024-09-21T07:34:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58dd7fa640 1 -- 172.21.15.60:0/556066712 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d4003aa0 con 0x7f58e0105300 2024-09-21T07:34:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58dd7fa640 1 -- 172.21.15.60:0/556066712 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4035070 con 0x7f58e0105300 2024-09-21T07:34:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.157+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01a7020 con 0x7f58e0105300 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 Processor -- start 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 -- start start 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed70310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 0x56430ed70850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed70d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56430ece3c10 con 0x56430e99d0a0 2024-09-21T07:34:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56430ecd3040 con 0x56430e9c5f60 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56430ecd6e50 con 0x56430e9a5280 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 0x56430ed70850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58dd7fa640 1 -- 172.21.15.60:0/556066712 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f58d4042030 con 0x7f58e0105300 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 0x56430ed70850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60132/0 (socket says 172.21.15.60:60132) 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.160+0000 7f58dffff640 1 -- 172.21.15.60:0/3021668558 learned_addr learned my addr 172.21.15.60:0/3021668558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58e4f68640 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed70310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dffff640 1 -- 172.21.15.60:0/3021668558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 msgr2=0x56430ed70d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dffff640 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed70d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dffff640 1 -- 172.21.15.60:0/3021668558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 msgr2=0x56430ed70310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dffff640 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed70310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dffff640 1 -- 172.21.15.60:0/3021668558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430ea31540 con 0x56430e99d0a0 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dffff640 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 0x56430ed70850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009a40 tx=0x7f58d0009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdc13cfb3c34796 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58c67fc640 1 -- 172.21.15.60:0/3021668558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0017070 con 0x56430e99d0a0 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58c67fc640 1 -- 172.21.15.60:0/3021668558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d0013470 con 0x56430e99d0a0 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58c67fc640 1 -- 172.21.15.60:0/3021668558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d00125d0 con 0x56430e99d0a0 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58dd7fa640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f58c80b65a0 0x7f58c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.161+0000 7f58e4f68640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f58c80b65a0 0x7f58c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58dd7fa640 1 -- 172.21.15.60:0/556066712 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f58d4107c90 con 0x7f58e0105300 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3021668558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 msgr2=0x56430ed70850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58e4f68640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f58c80b65a0 0x7f58c80b8ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58d800ae60 tx=0x7f58d800a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 0x56430ed70850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009a40 tx=0x7f58d0009f00 comp rx=0 tx=0).stop 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3021668558 shutdown_connections 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed70d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e99d0a0 0x56430ed70850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3021668558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed70310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3021668558 >> 172.21.15.60:0/3021668558 conn(0x56430e9ba350 msgr2=0x56430ed6e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3021668558 shutdown_connections 2024-09-21T07:34:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.162+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3021668558 wait complete. 2024-09-21T07:34:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 -- start start 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 Processor -- start 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e99d0a0 0x56430ed7be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed7c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed87e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56430eb345f0 con 0x56430e9a5280 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56430ec6e010 con 0x56430e9c5f60 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56430ed7eaf0 con 0x56430e99d0a0 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58ecf3f740 10 client.0 _ll_register_callbacks cb 0x56430eccd340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed7c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed7c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60136/0 (socket says 172.21.15.60:60136) 2024-09-21T07:34:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58df7fe640 1 -- 172.21.15.60:0/3914821472 learned_addr learned my addr 172.21.15.60:0/3914821472 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.163+0000 7f58e4f68640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed87e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58dffff640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e99d0a0 0x56430ed7be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58df7fe640 1 -- 172.21.15.60:0/3914821472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e99d0a0 msgr2=0x56430ed7be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58df7fe640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e99d0a0 0x56430ed7be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58df7fe640 1 -- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 msgr2=0x56430ed87e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58df7fe640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed87e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58df7fe640 1 -- 172.21.15.60:0/3914821472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430ec9ba00 con 0x56430e9a5280 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58df7fe640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed7c340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58d40cd9f0 tx=0x7f58d4105af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a86ed65d6b4a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58bf7fe640 1 -- 172.21.15.60:0/3914821472 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4049030 con 0x56430e9a5280 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58bf7fe640 1 -- 172.21.15.60:0/3914821472 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f58d4003c50 con 0x56430e9a5280 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d0013470 con 0x56430e9a5280 2024-09-21T07:34:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58bf7fe640 1 -- 172.21.15.60:0/3914821472 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58d40b90d0 con 0x56430e9a5280 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58ecf3f740 10 client.15276 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.164+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56430ed8aa10 con 0x56430e9a5280 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58bf7fe640 1 -- 172.21.15.60:0/3914821472 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d0013470 con 0x56430e9a5280 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58bf7fe640 1 -- 172.21.15.60:0/3914821472 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58d40c9f60 con 0x56430e9a5280 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58ecf3f740 10 client.15276 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58ecf3f740 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58ecf3f740 20 client.15276 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e9848e0 0x56430ed8e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58ecf3f740 4 client.15276 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 --> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56430ece5b60 con 0x56430e9848e0 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.165+0000 7f58dffff640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e9848e0 0x56430ed8e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.166+0000 7f58dffff640 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e9848e0 0x56430ed8e450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37430361441a9aab server_cookie=825dd9e935a5899e in_seq=0 out_seq=0 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.166+0000 7f58bf7fe640 10 client.15276 ms_handle_connect on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.166+0000 7f58bf7fe640 1 -- 172.21.15.60:0/3914821472 <== mds.1 v2:172.21.15.123:6836/2557983020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56430ece5b60 con 0x56430e9848e0 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.166+0000 7f58bf7fe640 10 client.15276 handle_command_reply: tid=0 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.166+0000 7f58ecf3f740 1 client.15276 shutdown 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 msgr2=0x56430ed7c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed7c340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f58d40cd9f0 tx=0x7f58d4105af0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 shutdown_connections 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e9848e0 0x56430ed8e450 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e9c5f60 0x56430ed87e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed7c340 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/3914821472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e99d0a0 0x56430ed7be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 >> 172.21.15.60:0/3914821472 conn(0x56430e9ba350 msgr2=0x56430ed734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58bf7fe640 0 client.15276 ms_handle_reset on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 shutdown_connections 2024-09-21T07:34:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 1 -- 172.21.15.60:0/3914821472 wait complete. 2024-09-21T07:34:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.167+0000 7f58ecf3f740 20 client.15276 trim_cache size 0 max 16384 2024-09-21T07:34:32.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 Processor -- start 2024-09-21T07:34:32.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 -- start start 2024-09-21T07:34:32.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed76430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed6e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9c5f60 0x56430ed8bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56430ed8c790 con 0x56430e9a5280 2024-09-21T07:34:32.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56430ed8ce60 con 0x56430e99d0a0 2024-09-21T07:34:32.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56430ed8d530 con 0x56430e9c5f60 2024-09-21T07:34:32.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed6e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed6e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60144/0 (socket says 172.21.15.60:60144) 2024-09-21T07:34:32.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.185+0000 7f58df7fe640 1 -- 172.21.15.60:0/805168297 learned_addr learned my addr 172.21.15.60:0/805168297 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:32.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58df7fe640 1 -- 172.21.15.60:0/805168297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9c5f60 msgr2=0x56430ed8bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58df7fe640 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9c5f60 0x56430ed8bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58df7fe640 1 -- 172.21.15.60:0/805168297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 msgr2=0x56430ed76430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58dffff640 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed76430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58df7fe640 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed76430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58df7fe640 1 -- 172.21.15.60:0/805168297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430ed7a100 con 0x56430e9a5280 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58dffff640 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed76430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58df7fe640 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed6e180 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f58d4105bf0 tx=0x7f58d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa3b8df8cee8345 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58c5ffb640 1 -- 172.21.15.60:0/805168297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4049070 con 0x56430e9a5280 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58c5ffb640 1 -- 172.21.15.60:0/805168297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d40cd800 con 0x56430e9a5280 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.186+0000 7f58c5ffb640 1 -- 172.21.15.60:0/805168297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d40c9f60 con 0x56430e9a5280 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 -- 172.21.15.60:0/805168297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 msgr2=0x56430ed6e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed6e180 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f58d4105bf0 tx=0x7f58d4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 -- 172.21.15.60:0/805168297 shutdown_connections 2024-09-21T07:34:32.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9c5f60 0x56430ed8bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9a5280 0x56430ed6e180 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/805168297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed76430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 -- 172.21.15.60:0/805168297 >> 172.21.15.60:0/805168297 conn(0x56430e9ba350 msgr2=0x56430ed6da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 -- 172.21.15.60:0/805168297 shutdown_connections 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 -- 172.21.15.60:0/805168297 wait complete. 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.187+0000 7f58ecf3f740 1 -- start start 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 Processor -- start 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed90950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed90e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 0x56430ed91410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56430ed8e2d0 con 0x56430e9c5f60 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56430ed8dc00 con 0x56430e99d0a0 2024-09-21T07:34:32.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56430ed8e9a0 con 0x56430e9a5280 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58ecf3f740 10 client.0 _ll_register_callbacks cb 0x7f58d4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 0x56430ed91410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 0x56430ed91410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60152/0 (socket says 172.21.15.60:60152) 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 -- 172.21.15.60:0/1546845116 learned_addr learned my addr 172.21.15.60:0/1546845116 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58dffff640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed90950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58df7fe640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed90e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 -- 172.21.15.60:0/1546845116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 msgr2=0x56430ed90e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed90e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 -- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 msgr2=0x56430ed90950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed90950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.188+0000 7f58e4f68640 1 -- 172.21.15.60:0/1546845116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430ed962e0 con 0x56430e9c5f60 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58e4f68640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 0x56430ed91410 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f58d8016f10 tx=0x7f58d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6465869a793ba763 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:32.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58bf7fe640 1 -- 172.21.15.60:0/1546845116 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8017420 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58bf7fe640 1 -- 172.21.15.60:0/1546845116 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f58d80175c0 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d40cd800 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58bf7fe640 1 -- 172.21.15.60:0/1546845116 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58d8017800 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58ecf3f740 10 client.15282 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56430edf9d80 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58bf7fe640 1 -- 172.21.15.60:0/1546845116 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d40cd800 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.189+0000 7f58bf7fe640 1 -- 172.21.15.60:0/1546845116 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58d802c9c0 con 0x56430e9c5f60 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58ecf3f740 10 client.15282 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58ecf3f740 10 client.15282 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58ecf3f740 20 client.15282 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e959c90 0x56430edfd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58ecf3f740 4 client.15282 mds_command: new command op to 24623 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:34:32.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 --> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] -- command(tid 0: {"prefix": "status"}) -- 0x56430ece1610 con 0x56430e959c90 2024-09-21T07:34:32.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58dffff640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e959c90 0x56430edfd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:32.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58dffff640 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e959c90 0x56430edfd6c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f33c3aaea1740d93 server_cookie=2a899522331630c2 in_seq=0 out_seq=0 2024-09-21T07:34:32.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.190+0000 7f58bf7fe640 10 client.15282 ms_handle_connect on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:32.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58bf7fe640 1 -- 172.21.15.60:0/1546845116 <== mds.1 v2:172.21.15.123:6836/2557983020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56430ece1610 con 0x56430e959c90 2024-09-21T07:34:32.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58bf7fe640 10 client.15282 handle_command_reply: tid=0 2024-09-21T07:34:32.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 client.15282 shutdown 2024-09-21T07:34:32.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 msgr2=0x56430ed91410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 0x56430ed91410 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f58d8016f10 tx=0x7f58d8004a40 comp rx=0 tx=0).stop 2024-09-21T07:34:32.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 shutdown_connections 2024-09-21T07:34:32.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:6836/2557983020,v1:172.21.15.123:6837/2557983020] conn(0x56430e959c90 0x56430edfd6c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56430e9c5f60 0x56430ed91410 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56430e9a5280 0x56430ed90e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58bf7fe640 0 client.15282 ms_handle_reset on v2:172.21.15.123:6836/2557983020 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 --2- 172.21.15.60:0/1546845116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56430e99d0a0 0x56430ed90950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 >> 172.21.15.60:0/1546845116 conn(0x56430e9ba350 msgr2=0x56430ed683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 shutdown_connections 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 1 -- 172.21.15.60:0/1546845116 wait complete. 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.191+0000 7f58ecf3f740 20 client.15282 trim_cache size 0 max 16384 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24623, 2024-09-21T07:34:32.199 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 90.830244706000002, 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 24, 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 76, 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 118.698915516 2024-09-21T07:34:32.200 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f58c80b65a0 msgr2=0x7f58c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f58c80b65a0 0x7f58c80b8ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58d800ae60 tx=0x7f58d800a480 comp rx=0 tx=0).stop 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 msgr2=0x7f58e019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e019ac00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f58d402a930 tx=0x7f58d4004270 comp rx=0 tx=0).stop 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 shutdown_connections 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f58c80b65a0 0x7f58c80b8ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e010de10 0x7f58e019fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58e0105300 0x7f58e019ac00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 --2- 172.21.15.60:0/556066712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58e01049b0 0x7f58e019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 >> 172.21.15.60:0/556066712 conn(0x7f58e0079730 msgr2=0x7f58e0100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:32.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 shutdown_connections 2024-09-21T07:34:32.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:32.192+0000 7f58e69cb640 1 -- 172.21.15.60:0/556066712 wait complete. 2024-09-21T07:34:32.888 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:34:33.181 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 -- 172.21.15.60:0/1259449339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec1083c0 msgr2=0x7f51ec1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 --2- 172.21.15.60:0/1259449339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec1083c0 0x7f51ec1087d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009900 tx=0x7f51d402a410 comp rx=0 tx=0).stop 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 -- 172.21.15.60:0/1259449339 shutdown_connections 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 --2- 172.21.15.60:0/1259449339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec108d10 0x7f51ec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 --2- 172.21.15.60:0/1259449339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec1083c0 0x7f51ec1087d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 --2- 172.21.15.60:0/1259449339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51ec102a80 0x7f51ec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 -- 172.21.15.60:0/1259449339 >> 172.21.15.60:0/1259449339 conn(0x7f51ec079740 msgr2=0x7f51ec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 -- 172.21.15.60:0/1259449339 shutdown_connections 2024-09-21T07:34:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.654+0000 7f51f14be640 1 -- 172.21.15.60:0/1259449339 wait complete. 2024-09-21T07:34:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 Processor -- start 2024-09-21T07:34:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 -- start start 2024-09-21T07:34:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 0x7f51ec0ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec1083c0 0x7f51ec0ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51ec108d10 0x7f51ec100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1129e0 con 0x7f51ec102a80 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec112860 con 0x7f51ec1083c0 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51f14be640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec112b60 con 0x7f51ec108d10 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51eaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 0x7f51ec0ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51eaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 0x7f51ec0ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60180/0 (socket says 172.21.15.60:60180) 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51eaffd640 1 -- 172.21.15.60:0/679894747 learned_addr learned my addr 172.21.15.60:0/679894747 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51ec108d10 0x7f51ec100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.655+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec1083c0 0x7f51ec0ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51eaffd640 1 -- 172.21.15.60:0/679894747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51ec108d10 msgr2=0x7f51ec100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51eaffd640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51ec108d10 0x7f51ec100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51eaffd640 1 -- 172.21.15.60:0/679894747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec1083c0 msgr2=0x7f51ec0ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51eaffd640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec1083c0 0x7f51ec0ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51eaffd640 1 -- 172.21.15.60:0/679894747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec1a8780 con 0x7f51ec102a80 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51eaffd640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 0x7f51ec0ff690 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d770 tx=0x7f51e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51e3fff640 1 -- 172.21.15.60:0/679894747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4017070 con 0x7f51ec102a80 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec1a8a70 con 0x7f51ec102a80 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51e3fff640 1 -- 172.21.15.60:0/679894747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e40054d0 con 0x7f51ec102a80 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51e3fff640 1 -- 172.21.15.60:0/679894747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4004c30 con 0x7f51ec102a80 2024-09-21T07:34:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.656+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec1a8f80 con 0x7f51ec102a80 2024-09-21T07:34:33.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 Processor -- start 2024-09-21T07:34:33.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 -- start start 2024-09-21T07:34:33.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51e3fff640 1 -- 172.21.15.60:0/679894747 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f51e4004e10 con 0x7f51ec102a80 2024-09-21T07:34:33.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656850f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656851440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x562656851980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5626567c8c10 con 0x5626564aaf60 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5626567b8040 con 0x5626564820a0 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51f7a32740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x5626567bbe50 con 0x56265648a280 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656850f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656850f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60184/0 (socket says 172.21.15.60:60184) 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.659+0000 7f51eb7fe640 1 -- 172.21.15.60:0/2234261915 learned_addr learned my addr 172.21.15.60:0/2234261915 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eaffd640 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656851440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eb7fe640 1 -- 172.21.15.60:0/2234261915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 msgr2=0x562656851980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x562656851980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eb7fe640 1 -- 172.21.15.60:0/2234261915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 msgr2=0x562656851440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656851440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eb7fe640 1 -- 172.21.15.60:0/2234261915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562656516540 con 0x5626564aaf60 2024-09-21T07:34:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656850f00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00a430 tx=0x7f51dc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e782257984cfc13a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51e17fa640 1 -- 172.21.15.60:0/2234261915 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc013790 con 0x5626564aaf60 2024-09-21T07:34:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51e17fa640 1 -- 172.21.15.60:0/2234261915 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51dc019070 con 0x5626564aaf60 2024-09-21T07:34:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51e17fa640 1 -- 172.21.15.60:0/2234261915 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc014ce0 con 0x5626564aaf60 2024-09-21T07:34:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51e3fff640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f51d80b65a0 0x7f51d80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.660+0000 7f51eaffd640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f51d80b65a0 0x7f51d80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51e3fff640 1 -- 172.21.15.60:0/679894747 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f51e40e6f60 con 0x7f51ec102a80 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 -- 172.21.15.60:0/2234261915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 msgr2=0x562656850f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51eaffd640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f51d80b65a0 0x7f51d80b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x56265684fb80 tx=0x7f51e4094040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656850f00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00a430 tx=0x7f51dc009650 comp rx=0 tx=0).stop 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 -- 172.21.15.60:0/2234261915 shutdown_connections 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x562656851980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656851440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 --2- 172.21.15.60:0/2234261915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656850f00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 -- 172.21.15.60:0/2234261915 >> 172.21.15.60:0/2234261915 conn(0x56265649f350 msgr2=0x56265684edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 -- 172.21.15.60:0/2234261915 shutdown_connections 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.661+0000 7f51f7a32740 1 -- 172.21.15.60:0/2234261915 wait complete. 2024-09-21T07:34:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 -- start start 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 Processor -- start 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x56265685c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x56265685cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656868a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5626566195f0 con 0x5626564aaf60 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562656753010 con 0x5626564820a0 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56265685f6e0 con 0x56265648a280 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51f7a32740 10 client.0 _ll_register_callbacks cb 0x5626567b2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656868a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656868a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60186/0 (socket says 172.21.15.60:60186) 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51eb7fe640 1 -- 172.21.15.60:0/1230921385 learned_addr learned my addr 172.21.15.60:0/1230921385 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x56265685cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.662+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x56265685c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51eb7fe640 1 -- 172.21.15.60:0/1230921385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 msgr2=0x56265685cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x56265685cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51eb7fe640 1 -- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 msgr2=0x56265685c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x56265685c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51eb7fe640 1 -- 172.21.15.60:0/1230921385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562656780a00 con 0x5626564aaf60 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656868a00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0147c0 tx=0x7f51dc0148c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3c5c1c8c969af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51d27fc640 1 -- 172.21.15.60:0/1230921385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc013c20 con 0x5626564aaf60 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51d27fc640 1 -- 172.21.15.60:0/1230921385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f51dc013dc0 con 0x5626564aaf60 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51dc019070 con 0x5626564aaf60 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51d27fc640 1 -- 172.21.15.60:0/1230921385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f51dc01e480 con 0x5626564aaf60 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51f7a32740 10 client.15294 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:33.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56265686b5e0 con 0x5626564aaf60 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.663+0000 7f51d27fc640 1 -- 172.21.15.60:0/1230921385 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51dc019070 con 0x5626564aaf60 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51d27fc640 1 -- 172.21.15.60:0/1230921385 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f51dc020650 con 0x5626564aaf60 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51f7a32740 10 client.15294 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51f7a32740 10 client.15294 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51f7a32740 20 client.15294 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51f7a32740 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x5626564698e0 0x56265686ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51f7a32740 4 client.15294 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 --> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626567cab60 con 0x5626564698e0 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.664+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x5626564698e0 0x56265686ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.665+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x5626564698e0 0x56265686ec20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632d322ccbbf77b server_cookie=2a62ef1a60f45bf0 in_seq=0 out_seq=0 2024-09-21T07:34:33.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.665+0000 7f51d27fc640 10 client.15294 ms_handle_connect on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:33.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.665+0000 7f51d27fc640 1 -- 172.21.15.60:0/1230921385 <== mds.0 v2:172.21.15.123:6838/4279563434 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626567cab60 con 0x5626564698e0 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.665+0000 7f51d27fc640 10 client.15294 handle_command_reply: tid=0 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.665+0000 7f51f7a32740 1 client.15294 shutdown 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 msgr2=0x562656868a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656868a00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0147c0 tx=0x7f51dc0148c0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 shutdown_connections 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x5626564698e0 0x56265686ec20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564aaf60 0x562656868a00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56265648a280 0x56265685cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 --2- 172.21.15.60:0/1230921385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x56265685c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51d27fc640 0 client.15294 ms_handle_reset on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 >> 172.21.15.60:0/1230921385 conn(0x56265649f350 msgr2=0x5626568540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:33.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 shutdown_connections 2024-09-21T07:34:33.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 1 -- 172.21.15.60:0/1230921385 wait complete. 2024-09-21T07:34:33.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.666+0000 7f51f7a32740 20 client.15294 trim_cache size 0 max 16384 2024-09-21T07:34:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.684+0000 7f51f7a32740 1 Processor -- start 2024-09-21T07:34:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.684+0000 7f51f7a32740 1 -- start start 2024-09-21T07:34:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656868970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 0x562656868eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x5626568579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51f7a32740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56265686cf60 con 0x56265648a280 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51f7a32740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56265686d630 con 0x5626564820a0 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51f7a32740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56265686dd00 con 0x5626564aaf60 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 0x562656868eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 0x562656868eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60200/0 (socket says 172.21.15.60:60200) 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 -- 172.21.15.60:0/4051898674 learned_addr learned my addr 172.21.15.60:0/4051898674 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656868970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x5626568579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 -- 172.21.15.60:0/4051898674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 msgr2=0x5626568579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x5626568579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 -- 172.21.15.60:0/4051898674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 msgr2=0x562656868970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656868970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 -- 172.21.15.60:0/4051898674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626567b7fd0 con 0x56265648a280 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 0x562656868eb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f51d4005f70 tx=0x7f51d4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945df4fa778763a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.685+0000 7f51e0ff9640 1 -- 172.21.15.60:0/4051898674 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4035040 con 0x56265648a280 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51e0ff9640 1 -- 172.21.15.60:0/4051898674 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51d4005040 con 0x56265648a280 2024-09-21T07:34:33.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51e0ff9640 1 -- 172.21.15.60:0/4051898674 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4004b20 con 0x56265648a280 2024-09-21T07:34:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51f7a32740 1 -- 172.21.15.60:0/4051898674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 msgr2=0x562656868eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51f7a32740 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 0x562656868eb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f51d4005f70 tx=0x7f51d4009260 comp rx=0 tx=0).stop 2024-09-21T07:34:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51f7a32740 1 -- 172.21.15.60:0/4051898674 shutdown_connections 2024-09-21T07:34:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51f7a32740 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x5626568579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51f7a32740 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56265648a280 0x562656868eb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.686+0000 7f51f7a32740 1 --2- 172.21.15.60:0/4051898674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5626564820a0 0x562656868970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- 172.21.15.60:0/4051898674 >> 172.21.15.60:0/4051898674 conn(0x56265649f350 msgr2=0x56265685c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- 172.21.15.60:0/4051898674 shutdown_connections 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- 172.21.15.60:0/4051898674 wait complete. 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- start start 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 Processor -- start 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 0x562656877360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56265648a280 0x562656870810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x562656870d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56265686eaa0 con 0x5626564820a0 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56265686e3d0 con 0x56265648a280 2024-09-21T07:34:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x56265686f170 con 0x5626564aaf60 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51f7a32740 10 client.0 _ll_register_callbacks cb 0x7f51dc009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 0x562656877360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 0x562656877360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60212/0 (socket says 172.21.15.60:60212) 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.687+0000 7f51eb7fe640 1 -- 172.21.15.60:0/100881515 learned_addr learned my addr 172.21.15.60:0/100881515 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56265648a280 0x562656870810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51eb7fe640 1 -- 172.21.15.60:0/100881515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 msgr2=0x562656870d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x562656870d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51eb7fe640 1 -- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56265648a280 msgr2=0x562656870810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56265648a280 0x562656870810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51eb7fe640 1 -- 172.21.15.60:0/100881515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562656871290 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51eb7fe640 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 0x562656877360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f51dc002230 tx=0x7f51dc014a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5012aab2b4af37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51d27fc640 1 -- 172.21.15.60:0/100881515 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc020830 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51d27fc640 1 -- 172.21.15.60:0/100881515 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f51dc013a20 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51d4005040 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51d27fc640 1 -- 172.21.15.60:0/100881515 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f51dc009740 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51f7a32740 10 client.15300 fetch_fsmap learned FSMap version 24 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.688+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562656876ba0 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51d27fc640 1 -- 172.21.15.60:0/100881515 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51d4005040 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51d27fc640 1 -- 172.21.15.60:0/100881515 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f51dc01ec70 con 0x5626564820a0 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51f7a32740 10 client.15300 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51f7a32740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:34:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51f7a32740 20 client.15300 populate_metadata read hostname 'smithi060' 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51f7a32740 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x56265643ec90 0x5626568dd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51f7a32740 4 client.15300 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 --> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] -- command(tid 0: {"prefix": "status"}) -- 0x5626567c6610 con 0x56265643ec90 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.689+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x56265643ec90 0x5626568dd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51d27fc640 10 client.15300 ms_handle_connect on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51ea7fc640 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x56265643ec90 0x5626568dd340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d8185ceeeea4cd0 server_cookie=c332ae4cdbdae053 in_seq=0 out_seq=0 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51d27fc640 1 -- 172.21.15.60:0/100881515 <== mds.0 v2:172.21.15.123:6838/4279563434 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5626567c6610 con 0x56265643ec90 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51d27fc640 10 client.15300 handle_command_reply: tid=0 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 client.15300 shutdown 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 msgr2=0x562656877360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 0x562656877360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f51dc002230 tx=0x7f51dc014a40 comp rx=0 tx=0).stop 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 shutdown_connections 2024-09-21T07:34:33.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:6838/4279563434,v1:172.21.15.123:6839/4279563434] conn(0x56265643ec90 0x5626568dd340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626564aaf60 0x562656870d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56265648a280 0x562656870810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51d27fc640 0 client.15300 ms_handle_reset on v2:172.21.15.123:6838/4279563434 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 --2- 172.21.15.60:0/100881515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5626564820a0 0x562656877360 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 >> 172.21.15.60:0/100881515 conn(0x56265649f350 msgr2=0x5626568579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 shutdown_connections 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 1 -- 172.21.15.60:0/100881515 wait complete. 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.690+0000 7f51f7a32740 20 client.15300 trim_cache size 0 max 16384 2024-09-21T07:34:33.698 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "679a927c-77ea-11ef-baf5-efdc52797490", 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24653, 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 99.358981939000003, 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 24, 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 76, 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 109.528414892 2024-09-21T07:34:33.699 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:34:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f51d80b65a0 msgr2=0x7f51d80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f51d80b65a0 0x7f51d80b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x56265684fb80 tx=0x7f51e4094040 comp rx=0 tx=0).stop 2024-09-21T07:34:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 msgr2=0x7f51ec0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 0x7f51ec0ff690 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f51e400d770 tx=0x7f51e400dc30 comp rx=0 tx=0).stop 2024-09-21T07:34:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 shutdown_connections 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f51d80b65a0 0x7f51d80b8ab0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51ec108d10 0x7f51ec100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ec1083c0 0x7f51ec0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 --2- 172.21.15.60:0/679894747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51ec102a80 0x7f51ec0ff690 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 >> 172.21.15.60:0/679894747 conn(0x7f51ec079740 msgr2=0x7f51ec06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 shutdown_connections 2024-09-21T07:34:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:33.691+0000 7f51f14be640 1 -- 172.21.15.60:0/679894747 wait complete. 2024-09-21T07:34:33.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:33 smithi060 ceph-mon[31244]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:34.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:33 smithi187 ceph-mon[34367]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:34.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:33 smithi123 ceph-mon[34166]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:34:34.446 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:34:34.469 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:34:34.469 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T07:34:34.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:34.470 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-21T07:34:34.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:34.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-21T07:34:34.557 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-21T07:34:34.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:34:34.558 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T07:34:34.558 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:34:34.559 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:34.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:34:34.864 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:34:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 -- 172.21.15.60:0/2447282607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54104a30 msgr2=0x7fca54104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 --2- 172.21.15.60:0/2447282607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54104a30 0x7fca54104e40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fca50009900 tx=0x7fca5002a410 comp rx=0 tx=0).stop 2024-09-21T07:34:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 -- 172.21.15.60:0/2447282607 shutdown_connections 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 --2- 172.21.15.60:0/2447282607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5410de90 0x7fca54110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 --2- 172.21.15.60:0/2447282607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca54105380 0x7fca5410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 --2- 172.21.15.60:0/2447282607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54104a30 0x7fca54104e40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 -- 172.21.15.60:0/2447282607 >> 172.21.15.60:0/2447282607 conn(0x7fca54079770 msgr2=0x7fca54079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 -- 172.21.15.60:0/2447282607 shutdown_connections 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.330+0000 7fca5c5be640 1 -- 172.21.15.60:0/2447282607 wait complete. 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 Processor -- start 2024-09-21T07:34:35.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 -- start start 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca54104a30 0x7fca5419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 0x7fca5419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca5410de90 0x7fca5419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca54113b10 con 0x7fca54105380 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca54113990 con 0x7fca54104a30 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5c5be640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fca54113c90 con 0x7fca5410de90 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca59b59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 0x7fca5419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca59b59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 0x7fca5419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60228/0 (socket says 172.21.15.60:60228) 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca59b59640 1 -- 172.21.15.60:0/1358727836 learned_addr learned my addr 172.21.15.60:0/1358727836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5a35a640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca54104a30 0x7fca5419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.331+0000 7fca5ab5b640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca5410de90 0x7fca5419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca59b59640 1 -- 172.21.15.60:0/1358727836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca5410de90 msgr2=0x7fca5419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca59b59640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca5410de90 0x7fca5419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca59b59640 1 -- 172.21.15.60:0/1358727836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca54104a30 msgr2=0x7fca5419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca59b59640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca54104a30 0x7fca5419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca59b59640 1 -- 172.21.15.60:0/1358727836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca541a04b0 con 0x7fca54105380 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca5ab5b640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca5410de90 0x7fca5419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca59b59640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 0x7fca5419aae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e9c0 tx=0x7fca4800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4800ccc0 con 0x7fca54105380 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca480054d0 con 0x7fca54105380 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca541a07a0 con 0x7fca54105380 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48010430 con 0x7fca54105380 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.332+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541a6f00 con 0x7fca54105380 2024-09-21T07:34:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.333+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5406c260 con 0x7fca54105380 2024-09-21T07:34:35.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.334+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fca48005000 con 0x7fca54105380 2024-09-21T07:34:35.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.335+0000 7fca477fe640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fca400b6510 0x7fca400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:35.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.335+0000 7fca5a35a640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fca400b6510 0x7fca400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:35.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.335+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fca480e7890 con 0x7fca54105380 2024-09-21T07:34:35.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.336+0000 7fca5a35a640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fca400b6510 0x7fca400b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca50031440 tx=0x7fca50009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:35.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.338+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca48056710 con 0x7fca54105380 2024-09-21T07:34:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.567+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fca54104e40 con 0x7fca54105380 2024-09-21T07:34:35.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.567+0000 7fca477fe640 1 -- 172.21.15.60:0/1358727836 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fca480052f0 con 0x7fca54105380 2024-09-21T07:34:35.569 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:34:35.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fca400b6510 msgr2=0x7fca400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fca400b6510 0x7fca400b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fca50031440 tx=0x7fca50009560 comp rx=0 tx=0).stop 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 msgr2=0x7fca5419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 0x7fca5419aae0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e9c0 tx=0x7fca4800ee80 comp rx=0 tx=0).stop 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 shutdown_connections 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fca400b6510 0x7fca400b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca5410de90 0x7fca5419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca54105380 0x7fca5419aae0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 --2- 172.21.15.60:0/1358727836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca54104a30 0x7fca5419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 >> 172.21.15.60:0/1358727836 conn(0x7fca54079770 msgr2=0x7fca54100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 shutdown_connections 2024-09-21T07:34:35.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:35.570+0000 7fca5c5be640 1 -- 172.21.15.60:0/1358727836 wait complete. 2024-09-21T07:34:35.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:35 smithi060 ceph-mon[31244]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:35 smithi060 ceph-mon[31244]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:34:35.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:35 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1358727836' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:34:36.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:35 smithi123 ceph-mon[34166]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:36.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:35 smithi123 ceph-mon[34166]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:34:36.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:35 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1358727836' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:34:36.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:34:36.179 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:34:36.179 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:34:36.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:36.179 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:34:36.196 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42146sec preferred_lft 42146sec 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:34:36.197 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:34:36.198 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-21T07:34:36.198 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:34:36.198 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:34:36.198 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T07:34:36.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:34:36.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2024-09-21T07:34:36.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2024-09-21T07:34:36.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:34:36.199 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T07:34:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:35 smithi187 ceph-mon[34367]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:34:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:35 smithi187 ceph-mon[34367]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:34:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:35 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1358727836' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:34:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:34:36.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:36.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:36.410 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:34:36.435 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-21T07:34:36.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:36.437 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-21T07:34:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-21T07:34:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:34:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:34:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:34:36.509 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:34:36.509 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:34:36.510 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T07:34:36.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:34:36.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:34:36.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:34:36.510 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T07:34:36.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:34:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:36.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:36.818 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-21T07:34:36.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:36.836 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-09-21T07:34:36.891 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:34:36.892 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T07:34:36.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:34:36.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:34:36.892 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T07:34:36.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:34:37.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.011 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:34:37.012 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T07:34:37.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:34:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.141 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:34:37.141 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-21T07:34:37.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-21T07:34:37.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:34:37.141 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-21T07:34:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:34:37.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:34:37.220 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:37.235 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:34:37.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:34:37.236 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:37.296 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T07:34:37.296 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T07:34:37.296 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/61e58c50-89d3-4ee1-9aba-6d35b9d65b4d 2024-09-21T07:34:37.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:37.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/61e58c50-89d3-4ee1-9aba-6d35b9d65b4d /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T07:34:37.412 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T07:34:37.412 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T07:34:37.412 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2024-09-21T07:34:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T07:34:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T07:34:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:invalid new device string format 2024-09-21T07:34:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.123:3300,172.21.15.187:3300" 2024-09-21T07:34:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.60:3300,172.21.15.123:3300,172.21.15.187:3300:/volumes/qa/sv_1/61e58c50-89d3-4ee1-9aba-6d35b9d65b4d 2024-09-21T07:34:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=679a927c-77ea-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T07:34:37.554 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:34:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:34:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:34:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:34:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:34:37.556 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:34:37.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:34:37.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:37.583 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:34:37.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:37.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.682 INFO:teuthology.orchestra.run.smithi060.stdout:client25025 2024-09-21T07:34:37.682 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:34:37.682 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:34:37.699 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:34:37.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:37.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.799 INFO:teuthology.orchestra.run.smithi060.stdout:client25025 2024-09-21T07:34:37.799 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:34:37.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:34:37.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.856 INFO:teuthology.orchestra.run.smithi060.stdout:client25025 2024-09-21T07:34:37.857 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/679a927c-77ea-11ef-baf5-efdc52797490.client25025/status') 2024-09-21T07:34:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:34:37.917 INFO:teuthology.orchestra.run.smithi060.stdout:instance: client.25025 (3)172.21.15.60:0/2891026092 2024-09-21T07:34:37.917 INFO:teuthology.orchestra.run.smithi060.stdout:blocklisted: false 2024-09-21T07:34:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2024-09-21T07:34:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2024-09-21T07:34:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:71 bytes copied, 2.7328e-05 s, 2.6 MB/s 2024-09-21T07:34:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:34:37.924 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:34:37.936 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:34:37.936 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T07:34:37.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T07:34:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 -- 172.21.15.60:0/1174903897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 msgr2=0x7fcce8103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 --2- 172.21.15.60:0/1174903897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce8103a30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009900 tx=0x7fccdc02a410 comp rx=0 tx=0).stop 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 -- 172.21.15.60:0/1174903897 shutdown_connections 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 --2- 172.21.15.60:0/1174903897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 0x7fcce810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 --2- 172.21.15.60:0/1174903897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce8103a30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 --2- 172.21.15.60:0/1174903897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce81025a0 0x7fcce8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 -- 172.21.15.60:0/1174903897 >> 172.21.15.60:0/1174903897 conn(0x7fcce80fdee0 msgr2=0x7fcce8100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.049+0000 7fccefeec640 1 -- 172.21.15.60:0/1174903897 shutdown_connections 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 -- 172.21.15.60:0/1174903897 wait complete. 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 Processor -- start 2024-09-21T07:34:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 -- start start 2024-09-21T07:34:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce81025a0 0x7fcce8198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 0x7fcce819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810e1e0 con 0x7fcce8103620 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810e060 con 0x7fcce81025a0 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.050+0000 7fccefeec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fcce810e360 con 0x7fcce8103fc0 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce81994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52988/0 (socket says 172.21.15.60:52988) 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 -- 172.21.15.60:0/2806343026 learned_addr learned my addr 172.21.15.60:0/2806343026 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccedc88640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce81025a0 0x7fcce8198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccee489640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 0x7fcce819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 -- 172.21.15.60:0/2806343026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 msgr2=0x7fcce819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 0x7fcce819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 -- 172.21.15.60:0/2806343026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce81025a0 msgr2=0x7fcce8198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce81025a0 0x7fcce8198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 -- 172.21.15.60:0/2806343026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce819a8b0 con 0x7fcce8103620 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccee489640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 0x7fcce819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fcced487640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce81994e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fccdc006010 tx=0x7fccdc004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc046070 con 0x7fcce8103620 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce819ab40 con 0x7fcce8103620 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccdc0044b0 con 0x7fcce8103620 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc035050 con 0x7fcce8103620 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.051+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce806adc0 con 0x7fcce8103620 2024-09-21T07:34:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.052+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce8102a10 con 0x7fcce8103620 2024-09-21T07:34:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.054+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fccdc049070 con 0x7fcce8103620 2024-09-21T07:34:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.055+0000 7fccdaffd640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fccd40b6510 0x7fccd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.055+0000 7fccedc88640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fccd40b6510 0x7fccd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.055+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fccdc109420 con 0x7fcce8103620 2024-09-21T07:34:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.055+0000 7fccedc88640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fccd40b6510 0x7fccd40b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005d00 tx=0x7fcce400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.058+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fccdc050080 con 0x7fcce8103620 2024-09-21T07:34:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:37 smithi123 ceph-mon[34166]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T07:34:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:37 smithi060 ceph-mon[31244]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T07:34:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:37 smithi187 ceph-mon[34367]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T07:34:38.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.283+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fcce806b8a0 con 0x7fcce8103620 2024-09-21T07:34:38.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.782+0000 7fccdaffd640 1 -- 172.21.15.60:0/2806343026 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fccdc0cfce0 con 0x7fcce8103620 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fccd40b6510 msgr2=0x7fccd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fccd40b6510 0x7fccd40b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005d00 tx=0x7fcce400b410 comp rx=0 tx=0).stop 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 msgr2=0x7fcce81994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce81994e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fccdc006010 tx=0x7fccdc004340 comp rx=0 tx=0).stop 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 shutdown_connections 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fccd40b6510 0x7fccd40b8a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcce8103fc0 0x7fcce819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcce8103620 0x7fcce81994e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 --2- 172.21.15.60:0/2806343026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcce81025a0 0x7fcce8198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 >> 172.21.15.60:0/2806343026 conn(0x7fcce80fdee0 msgr2=0x7fcce8106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:38.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 shutdown_connections 2024-09-21T07:34:38.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.785+0000 7fccefeec640 1 -- 172.21.15.60:0/2806343026 wait complete. 2024-09-21T07:34:38.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 -- 172.21.15.60:0/2848814350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f0103fc0 msgr2=0x7fe1f010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 --2- 172.21.15.60:0/2848814350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f0103fc0 0x7fe1f010a960 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009c90 tx=0x7fe1e802a860 comp rx=0 tx=0).stop 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 -- 172.21.15.60:0/2848814350 shutdown_connections 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 --2- 172.21.15.60:0/2848814350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f0103fc0 0x7fe1f010a960 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 --2- 172.21.15.60:0/2848814350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f0103620 0x7fe1f0103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 --2- 172.21.15.60:0/2848814350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f01025a0 0x7fe1f0102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 -- 172.21.15.60:0/2848814350 >> 172.21.15.60:0/2848814350 conn(0x7fe1f00fdee0 msgr2=0x7fe1f0100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 -- 172.21.15.60:0/2848814350 shutdown_connections 2024-09-21T07:34:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.917+0000 7fe1f71da640 1 -- 172.21.15.60:0/2848814350 wait complete. 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 Processor -- start 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 -- start start 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 0x7fe1f006b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0103620 0x7fe1f019ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f0103fc0 0x7fe1f01a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010e240 con 0x7fe1f01025a0 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010e0c0 con 0x7fe1f0103620 2024-09-21T07:34:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f71da640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f010e3c0 con 0x7fe1f0103fc0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 0x7fe1f006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 0x7fe1f006b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53004/0 (socket says 172.21.15.60:53004) 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 -- 172.21.15.60:0/3256330180 learned_addr learned my addr 172.21.15.60:0/3256330180 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1effff640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0103620 0x7fe1f019ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f5777640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f0103fc0 0x7fe1f01a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 -- 172.21.15.60:0/3256330180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f0103fc0 msgr2=0x7fe1f01a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f0103fc0 0x7fe1f01a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 -- 172.21.15.60:0/3256330180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0103620 msgr2=0x7fe1f019ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0103620 0x7fe1f019ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 -- 172.21.15.60:0/3256330180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f01a1a20 con 0x7fe1f01025a0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1effff640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0103620 0x7fe1f019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.918+0000 7fe1f4f76640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 0x7fe1f006b430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e9f0 tx=0x7fe1e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.919+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000cd80 con 0x7fe1f01025a0 2024-09-21T07:34:38.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.919+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e00108e0 con 0x7fe1f01025a0 2024-09-21T07:34:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.919+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f01a1d10 con 0x7fe1f01025a0 2024-09-21T07:34:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.919+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0018980 con 0x7fe1f01025a0 2024-09-21T07:34:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.919+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f01a21b0 con 0x7fe1f01025a0 2024-09-21T07:34:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.920+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f0109750 con 0x7fe1f01025a0 2024-09-21T07:34:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.922+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe1e0010430 con 0x7fe1f01025a0 2024-09-21T07:34:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.922+0000 7fe1edffb640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1d80b6510 0x7fe1d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:34:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.922+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fe1e00e7bd0 con 0x7fe1f01025a0 2024-09-21T07:34:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.922+0000 7fe1effff640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1d80b6510 0x7fe1d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:34:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.923+0000 7fe1effff640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1d80b6510 0x7fe1d80b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40058c0 tx=0x7fe1e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:34:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:38.925+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1e00ae490 con 0x7fe1f01025a0 2024-09-21T07:34:39.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:38 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2806343026' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:34:39.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:38 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2806343026' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:34:39.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.142+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 --> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fe1f0063960 con 0x7fe1d80b6510 2024-09-21T07:34:39.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.164+0000 7fe1edffb640 1 -- 172.21.15.60:0/3256330180 <== mgr.14150 v2:172.21.15.60:6800/2850568081 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fe1f0063960 con 0x7fe1d80b6510 2024-09-21T07:34:39.165 INFO:teuthology.orchestra.run.smithi060.stdout:{} 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1d80b6510 msgr2=0x7fe1d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1d80b6510 0x7fe1d80b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40058c0 tx=0x7fe1e4005850 comp rx=0 tx=0).stop 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 msgr2=0x7fe1f006b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 0x7fe1f006b430 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e9f0 tx=0x7fe1e000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 shutdown_connections 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fe1d80b6510 0x7fe1d80b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:39.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f0103fc0 0x7fe1f01a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:39.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1f0103620 0x7fe1f019ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:39.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 --2- 172.21.15.60:0/3256330180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1f01025a0 0x7fe1f006b430 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:34:39.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 >> 172.21.15.60:0/3256330180 conn(0x7fe1f00fdee0 msgr2=0x7fe1f0106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:34:39.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 shutdown_connections 2024-09-21T07:34:39.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:34:39.166+0000 7fe1f71da640 1 -- 172.21.15.60:0/3256330180 wait complete. 2024-09-21T07:34:39.179 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T07:34:39.190 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T07:34:39.253 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:34:39.253 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T07:34:39.253 INFO:tasks.workunit:timeout=3h 2024-09-21T07:34:39.253 INFO:tasks.workunit:cleanup=True 2024-09-21T07:34:39.254 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:39.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:38 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2806343026' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 07:33:11.973060656 +0000 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 07:33:11.973060656 +0000 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 07:34:37.579229567 +0000 2024-09-21T07:34:39.270 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 07:33:11.973060656 +0000 2024-09-21T07:34:39.271 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T07:34:39.271 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T07:34:39.341 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:34:39.398 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T07:34:39.621 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:34:39.147+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:34:39.622 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:34:39.147+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:34:39.622 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:34:39.147+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:34:39.622 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:34:39.147+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:34:39.622 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T07:34:39.147+0000 7fa248395640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:34:40.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:39 smithi123 ceph-mon[34166]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T07:34:40.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:39 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2806343026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:34:40.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:39 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:34:40.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:39 smithi123 ceph-mon[34166]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-mon[31244]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T07:34:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2806343026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:34:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:34:40.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:39 smithi060 ceph-mon[31244]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:39 smithi187 ceph-mon[34367]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T07:34:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:39 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2806343026' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T07:34:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:39 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:34:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:39 smithi187 ceph-mon[34367]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:34:42.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:41 smithi123 ceph-mon[34166]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T07:34:42.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:41 smithi123 ceph-mon[34166]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T07:34:42.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:41 smithi060 ceph-mon[31244]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T07:34:42.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:41 smithi060 ceph-mon[31244]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T07:34:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:41 smithi187 ceph-mon[34367]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T07:34:42.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:41 smithi187 ceph-mon[34367]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-21T07:34:44.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:43 smithi123 ceph-mon[34166]: pgmap v341: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-21T07:34:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:43 smithi060 ceph-mon[31244]: pgmap v341: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-21T07:34:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:43 smithi187 ceph-mon[34367]: pgmap v341: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-21T07:34:46.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:45 smithi123 ceph-mon[34166]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T07:34:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:45 smithi060 ceph-mon[31244]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T07:34:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:45 smithi187 ceph-mon[34367]: pgmap v342: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T07:34:48.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:47 smithi123 ceph-mon[34166]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T07:34:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:47 smithi060 ceph-mon[31244]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T07:34:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:47 smithi187 ceph-mon[34367]: pgmap v343: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-21T07:34:50.072 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:49 smithi187 ceph-mon[34367]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-21T07:34:50.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:49 smithi123 ceph-mon[34166]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-21T07:34:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:49 smithi060 ceph-mon[31244]: pgmap v344: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-21T07:34:52.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:51 smithi123 ceph-mon[34166]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T07:34:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:51 smithi060 ceph-mon[31244]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T07:34:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:51 smithi187 ceph-mon[34367]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T07:34:54.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:53 smithi123 ceph-mon[34166]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-21T07:34:54.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:53 smithi060 ceph-mon[31244]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-21T07:34:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:53 smithi187 ceph-mon[34367]: pgmap v346: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-21T07:34:56.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:55 smithi123 ceph-mon[34166]: pgmap v347: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T07:34:56.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:55 smithi060 ceph-mon[31244]: pgmap v347: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T07:34:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:55 smithi187 ceph-mon[34367]: pgmap v347: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T07:34:58.100 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:57 smithi123 ceph-mon[34166]: pgmap v348: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:34:58.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:57 smithi060 ceph-mon[31244]: pgmap v348: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:34:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:57 smithi187 ceph-mon[34367]: pgmap v348: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:35:00.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:59 smithi123 ceph-mon[34166]: pgmap v349: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:35:00.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:34:59 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:35:00.118 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:59 smithi187 ceph-mon[34367]: pgmap v349: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:35:00.118 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:34:59 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:35:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:59 smithi060 ceph-mon[31244]: pgmap v349: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T07:35:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:34:59 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:35:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:35:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:35:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: pgmap v350: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:35:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:35:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:03 smithi187 ceph-mon[34367]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:35:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:03 smithi123 ceph-mon[34166]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:35:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:03 smithi060 ceph-mon[31244]: pgmap v351: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T07:35:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:05 smithi187 ceph-mon[34367]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:05 smithi123 ceph-mon[34166]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:05 smithi060 ceph-mon[31244]: pgmap v352: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:08.272 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:07 smithi187 ceph-mon[34367]: pgmap v353: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:35:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:07 smithi123 ceph-mon[34166]: pgmap v353: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:35:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:07 smithi060 ceph-mon[31244]: pgmap v353: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:35:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:09 smithi187 ceph-mon[34367]: pgmap v354: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:35:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:09 smithi123 ceph-mon[34166]: pgmap v354: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:35:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:09 smithi060 ceph-mon[31244]: pgmap v354: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:35:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:11 smithi187 ceph-mon[34367]: pgmap v355: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:11 smithi123 ceph-mon[34166]: pgmap v355: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:11 smithi060 ceph-mon[31244]: pgmap v355: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:13 smithi187 ceph-mon[34367]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:13 smithi123 ceph-mon[34166]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:13 smithi060 ceph-mon[31244]: pgmap v356: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:15 smithi187 ceph-mon[34367]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:15 smithi123 ceph-mon[34166]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:15 smithi060 ceph-mon[31244]: pgmap v357: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:17 smithi187 ceph-mon[34367]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T07:35:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:17 smithi123 ceph-mon[34166]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T07:35:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:17 smithi060 ceph-mon[31244]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T07:35:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:19 smithi187 ceph-mon[34367]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T07:35:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:19 smithi123 ceph-mon[34166]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T07:35:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:19 smithi060 ceph-mon[31244]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T07:35:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:21 smithi187 ceph-mon[34367]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:35:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:21 smithi123 ceph-mon[34166]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:35:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:21 smithi060 ceph-mon[31244]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:35:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:23 smithi187 ceph-mon[34367]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:35:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:23 smithi123 ceph-mon[34166]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:35:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:23 smithi060 ceph-mon[31244]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:35:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:25 smithi187 ceph-mon[34367]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:35:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:25 smithi123 ceph-mon[34166]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:35:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:25 smithi060 ceph-mon[31244]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T07:35:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:27 smithi187 ceph-mon[34367]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:35:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:27 smithi123 ceph-mon[34166]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:35:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:27 smithi060 ceph-mon[31244]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T07:35:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:29 smithi187 ceph-mon[34367]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T07:35:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:29 smithi123 ceph-mon[34166]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T07:35:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:29 smithi060 ceph-mon[31244]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T07:35:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:31 smithi187 ceph-mon[34367]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:31 smithi123 ceph-mon[34166]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:31 smithi060 ceph-mon[31244]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:33 smithi187 ceph-mon[34367]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:33 smithi123 ceph-mon[34166]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:33 smithi060 ceph-mon[31244]: pgmap v366: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:35 smithi187 ceph-mon[34367]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:35 smithi123 ceph-mon[34166]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:35 smithi060 ceph-mon[31244]: pgmap v367: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:37 smithi187 ceph-mon[34367]: pgmap v368: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:35:38.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:37 smithi123 ceph-mon[34166]: pgmap v368: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:35:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:37 smithi060 ceph-mon[31244]: pgmap v368: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T07:35:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:39 smithi187 ceph-mon[34367]: pgmap v369: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:35:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:39 smithi123 ceph-mon[34166]: pgmap v369: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:35:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:39 smithi060 ceph-mon[31244]: pgmap v369: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T07:35:41.318 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 93% (11833/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T07:35:41.911 INFO:tasks.workunit.client.0.smithi060.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T07:35:41.911 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.911 INFO:tasks.workunit.client.0.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: git switch -c 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr:Or undo this operation with: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: git switch - 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.912 INFO:tasks.workunit.client.0.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T07:35:41.913 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-21T07:35:41.913 INFO:tasks.workunit.client.0.smithi060.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:35:41.917 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T07:35:41.980 INFO:tasks.workunit.client.0.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T07:35:41.983 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:35:41.983 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T07:35:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:41 smithi187 ceph-mon[34367]: pgmap v370: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:42.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:41 smithi123 ceph-mon[34166]: pgmap v370: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:41 smithi060 ceph-mon[31244]: pgmap v370: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T07:35:42.679 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T07:35:42.760 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T07:35:42.802 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:35:42.804 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:35:42.804 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T07:35:42.844 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:35:42.847 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T07:35:42.848 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T07:35:42.904 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-09-21T07:35:42.905 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-09-21T07:35:42.906 DEBUG:teuthology.orchestra.run.smithi060:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-09-21T07:35:42.968 INFO:tasks.workunit.client.0.smithi060.stderr:+ dbench 1 2024-09-21T07:35:42.976 INFO:tasks.workunit.client.0.smithi060.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-21T07:35:42.976 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-21T07:35:42.976 INFO:tasks.workunit.client.0.smithi060.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-21T07:35:42.987 INFO:tasks.workunit.client.0.smithi060.stdout:0 of 1 processes prepared for launch 0 sec 2024-09-21T07:35:43.087 INFO:tasks.workunit.client.0.smithi060.stdout:1 of 1 processes prepared for launch 0 sec 2024-09-21T07:35:43.087 INFO:tasks.workunit.client.0.smithi060.stdout:releasing clients 2024-09-21T07:35:44.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 3209 34.28 MB/sec warmup 1 sec latency 8.087 ms 2024-09-21T07:35:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:43 smithi187 ceph-mon[34367]: pgmap v371: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:43 smithi123 ceph-mon[34166]: pgmap v371: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:43 smithi060 ceph-mon[31244]: pgmap v371: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T07:35:45.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 6140 24.04 MB/sec warmup 2 sec latency 11.721 ms 2024-09-21T07:35:46.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 8974 21.53 MB/sec warmup 3 sec latency 12.512 ms 2024-09-21T07:35:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:45 smithi187 ceph-mon[34367]: pgmap v372: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:45 smithi123 ceph-mon[34166]: pgmap v372: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:45 smithi060 ceph-mon[31244]: pgmap v372: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T07:35:47.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 11572 19.78 MB/sec warmup 4 sec latency 19.938 ms 2024-09-21T07:35:48.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 14731 19.49 MB/sec warmup 5 sec latency 7.117 ms 2024-09-21T07:35:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:47 smithi187 ceph-mon[34367]: pgmap v373: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 293 KiB/s wr, 54 op/s 2024-09-21T07:35:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:47 smithi123 ceph-mon[34166]: pgmap v373: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 293 KiB/s wr, 54 op/s 2024-09-21T07:35:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:47 smithi060 ceph-mon[31244]: pgmap v373: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 293 KiB/s wr, 54 op/s 2024-09-21T07:35:49.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 17995 19.37 MB/sec warmup 6 sec latency 16.616 ms 2024-09-21T07:35:50.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 21120 18.72 MB/sec warmup 7 sec latency 18.640 ms 2024-09-21T07:35:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:49 smithi187 ceph-mon[34367]: pgmap v374: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 534 KiB/s wr, 66 op/s 2024-09-21T07:35:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:49 smithi123 ceph-mon[34166]: pgmap v374: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 534 KiB/s wr, 66 op/s 2024-09-21T07:35:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:49 smithi060 ceph-mon[31244]: pgmap v374: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 534 KiB/s wr, 66 op/s 2024-09-21T07:35:51.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 23773 17.86 MB/sec warmup 8 sec latency 11.268 ms 2024-09-21T07:35:52.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 26112 17.44 MB/sec warmup 9 sec latency 20.597 ms 2024-09-21T07:35:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:51 smithi187 ceph-mon[34367]: pgmap v375: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 534 KiB/s wr, 65 op/s 2024-09-21T07:35:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:51 smithi123 ceph-mon[34166]: pgmap v375: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 534 KiB/s wr, 65 op/s 2024-09-21T07:35:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:51 smithi060 ceph-mon[31244]: pgmap v375: 97 pgs: 97 active+clean; 5.7 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 534 KiB/s wr, 65 op/s 2024-09-21T07:35:53.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 29036 17.40 MB/sec warmup 10 sec latency 8.106 ms 2024-09-21T07:35:54.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 32345 17.55 MB/sec warmup 11 sec latency 12.513 ms 2024-09-21T07:35:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:53 smithi187 ceph-mon[34367]: pgmap v376: 97 pgs: 97 active+clean; 8.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 862 KiB/s wr, 100 op/s 2024-09-21T07:35:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:53 smithi123 ceph-mon[34166]: pgmap v376: 97 pgs: 97 active+clean; 8.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 862 KiB/s wr, 100 op/s 2024-09-21T07:35:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:53 smithi060 ceph-mon[31244]: pgmap v376: 97 pgs: 97 active+clean; 8.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 862 KiB/s wr, 100 op/s 2024-09-21T07:35:55.087 INFO:tasks.workunit.client.0.smithi060.stdout: 1 35506 17.55 MB/sec warmup 12 sec latency 17.130 ms 2024-09-21T07:35:56.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 38116 16.94 MB/sec warmup 13 sec latency 11.561 ms 2024-09-21T07:35:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:55 smithi187 ceph-mon[34367]: pgmap v377: 97 pgs: 97 active+clean; 13 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-09-21T07:35:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:55 smithi123 ceph-mon[34166]: pgmap v377: 97 pgs: 97 active+clean; 13 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-09-21T07:35:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:55 smithi060 ceph-mon[31244]: pgmap v377: 97 pgs: 97 active+clean; 13 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-09-21T07:35:57.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 40466 16.88 MB/sec warmup 14 sec latency 35.692 ms 2024-09-21T07:35:58.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 43378 16.72 MB/sec warmup 15 sec latency 11.317 ms 2024-09-21T07:35:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:57 smithi187 ceph-mon[34367]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-21T07:35:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:57 smithi123 ceph-mon[34166]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-21T07:35:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:57 smithi060 ceph-mon[31244]: pgmap v378: 97 pgs: 97 active+clean; 14 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-21T07:35:59.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 46559 16.85 MB/sec warmup 16 sec latency 8.389 ms 2024-09-21T07:36:00.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 49686 16.88 MB/sec warmup 17 sec latency 25.796 ms 2024-09-21T07:36:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:35:59 smithi187 ceph-mon[34367]: pgmap v379: 97 pgs: 97 active+clean; 20 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-09-21T07:36:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:35:59 smithi123 ceph-mon[34166]: pgmap v379: 97 pgs: 97 active+clean; 20 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-09-21T07:36:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:35:59 smithi060 ceph-mon[31244]: pgmap v379: 97 pgs: 97 active+clean; 20 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-09-21T07:36:01.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 52609 16.73 MB/sec warmup 18 sec latency 22.946 ms 2024-09-21T07:36:02.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 55014 16.48 MB/sec warmup 19 sec latency 19.057 ms 2024-09-21T07:36:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: pgmap v380: 97 pgs: 97 active+clean; 20 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:36:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:01 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: pgmap v380: 97 pgs: 97 active+clean; 20 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:01 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: pgmap v380: 97 pgs: 97 active+clean; 20 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:02.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:01 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:03.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 57694 16.38 MB/sec warmup 20 sec latency 13.800 ms 2024-09-21T07:36:03.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:36:03.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:36:03.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:03.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:36:03.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:36:03.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:03.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:36:03.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:36:03.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:36:04.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 60919 16.48 MB/sec warmup 21 sec latency 7.492 ms 2024-09-21T07:36:04.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:04 smithi123 ceph-mon[34166]: pgmap v381: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.9 MiB/s wr, 250 op/s 2024-09-21T07:36:04.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:04 smithi060 ceph-mon[31244]: pgmap v381: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.9 MiB/s wr, 250 op/s 2024-09-21T07:36:04.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:04 smithi187 ceph-mon[34367]: pgmap v381: 97 pgs: 97 active+clean; 24 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.9 MiB/s wr, 250 op/s 2024-09-21T07:36:05.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 64138 16.58 MB/sec warmup 22 sec latency 18.129 ms 2024-09-21T07:36:06.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 67080 16.46 MB/sec warmup 23 sec latency 13.334 ms 2024-09-21T07:36:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:06 smithi123 ceph-mon[34166]: pgmap v382: 97 pgs: 97 active+clean; 25 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-09-21T07:36:06.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:06 smithi123 ceph-mon[34166]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T07:36:06.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:06 smithi060 ceph-mon[31244]: pgmap v382: 97 pgs: 97 active+clean; 25 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-09-21T07:36:06.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:06 smithi060 ceph-mon[31244]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T07:36:06.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:06 smithi187 ceph-mon[34367]: pgmap v382: 97 pgs: 97 active+clean; 25 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-09-21T07:36:06.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:06 smithi187 ceph-mon[34367]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-21T07:36:07.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 69875 16.31 MB/sec warmup 24 sec latency 11.063 ms 2024-09-21T07:36:08.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 72631 16.35 MB/sec warmup 25 sec latency 10.488 ms 2024-09-21T07:36:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:08 smithi123 ceph-mon[34166]: pgmap v383: 97 pgs: 97 active+clean; 28 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-21T07:36:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:08 smithi060 ceph-mon[31244]: pgmap v383: 97 pgs: 97 active+clean; 28 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-21T07:36:08.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:08 smithi187 ceph-mon[34367]: pgmap v383: 97 pgs: 97 active+clean; 28 MiB data, 513 MiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-21T07:36:09.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 75334 16.27 MB/sec warmup 26 sec latency 31.001 ms 2024-09-21T07:36:10.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 75802 15.73 MB/sec warmup 27 sec latency 666.002 ms 2024-09-21T07:36:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:10 smithi123 ceph-mon[34166]: pgmap v384: 97 pgs: 97 active+clean; 31 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 1.8 MiB/s wr, 232 op/s 2024-09-21T07:36:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:10 smithi060 ceph-mon[31244]: pgmap v384: 97 pgs: 97 active+clean; 31 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 1.8 MiB/s wr, 232 op/s 2024-09-21T07:36:10.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:10 smithi187 ceph-mon[34367]: pgmap v384: 97 pgs: 97 active+clean; 31 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 922 KiB/s rd, 1.8 MiB/s wr, 232 op/s 2024-09-21T07:36:11.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 78465 15.78 MB/sec warmup 28 sec latency 21.282 ms 2024-09-21T07:36:12.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 81470 15.73 MB/sec warmup 29 sec latency 18.667 ms 2024-09-21T07:36:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:12 smithi123 ceph-mon[34166]: pgmap v385: 97 pgs: 97 active+clean; 31 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-09-21T07:36:12.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:12 smithi060 ceph-mon[31244]: pgmap v385: 97 pgs: 97 active+clean; 31 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-09-21T07:36:12.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:12 smithi187 ceph-mon[34367]: pgmap v385: 97 pgs: 97 active+clean; 31 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 1.2 MiB/s wr, 151 op/s 2024-09-21T07:36:13.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 84025 15.59 MB/sec warmup 30 sec latency 11.986 ms 2024-09-21T07:36:14.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 86318 15.55 MB/sec warmup 31 sec latency 20.369 ms 2024-09-21T07:36:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:14 smithi123 ceph-mon[34166]: pgmap v386: 97 pgs: 97 active+clean; 42 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.0 MiB/s wr, 326 op/s 2024-09-21T07:36:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:14 smithi060 ceph-mon[31244]: pgmap v386: 97 pgs: 97 active+clean; 42 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.0 MiB/s wr, 326 op/s 2024-09-21T07:36:14.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:14 smithi187 ceph-mon[34367]: pgmap v386: 97 pgs: 97 active+clean; 42 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.0 MiB/s wr, 326 op/s 2024-09-21T07:36:15.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 89345 15.60 MB/sec warmup 32 sec latency 8.360 ms 2024-09-21T07:36:16.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 92427 15.66 MB/sec warmup 33 sec latency 42.980 ms 2024-09-21T07:36:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:16 smithi123 ceph-mon[34166]: pgmap v387: 97 pgs: 97 active+clean; 47 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.1 MiB/s wr, 369 op/s 2024-09-21T07:36:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:16 smithi060 ceph-mon[31244]: pgmap v387: 97 pgs: 97 active+clean; 47 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.1 MiB/s wr, 369 op/s 2024-09-21T07:36:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:16 smithi187 ceph-mon[34367]: pgmap v387: 97 pgs: 97 active+clean; 47 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.1 MiB/s wr, 369 op/s 2024-09-21T07:36:17.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 95163 15.59 MB/sec warmup 34 sec latency 13.715 ms 2024-09-21T07:36:18.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 97425 15.50 MB/sec warmup 35 sec latency 15.813 ms 2024-09-21T07:36:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:18 smithi123 ceph-mon[34166]: pgmap v388: 97 pgs: 97 active+clean; 49 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.1 MiB/s wr, 375 op/s 2024-09-21T07:36:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:18 smithi060 ceph-mon[31244]: pgmap v388: 97 pgs: 97 active+clean; 49 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.1 MiB/s wr, 375 op/s 2024-09-21T07:36:18.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:18 smithi187 ceph-mon[34367]: pgmap v388: 97 pgs: 97 active+clean; 49 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.1 MiB/s wr, 375 op/s 2024-09-21T07:36:19.088 INFO:tasks.workunit.client.0.smithi060.stdout: 1 100083 15.46 MB/sec warmup 36 sec latency 11.406 ms 2024-09-21T07:36:20.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 103184 15.55 MB/sec warmup 37 sec latency 11.839 ms 2024-09-21T07:36:20.570 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:20 smithi187 ceph-mon[34367]: pgmap v389: 97 pgs: 97 active+clean; 54 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 410 op/s 2024-09-21T07:36:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:20 smithi123 ceph-mon[34166]: pgmap v389: 97 pgs: 97 active+clean; 54 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 410 op/s 2024-09-21T07:36:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:20 smithi060 ceph-mon[31244]: pgmap v389: 97 pgs: 97 active+clean; 54 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 8.4 MiB/s wr, 410 op/s 2024-09-21T07:36:21.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 105829 15.48 MB/sec warmup 38 sec latency 49.248 ms 2024-09-21T07:36:22.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 108142 15.38 MB/sec warmup 39 sec latency 13.845 ms 2024-09-21T07:36:22.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:22 smithi123 ceph-mon[34166]: pgmap v390: 97 pgs: 97 active+clean; 54 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 372 op/s 2024-09-21T07:36:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:22 smithi060 ceph-mon[31244]: pgmap v390: 97 pgs: 97 active+clean; 54 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 372 op/s 2024-09-21T07:36:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:22 smithi187 ceph-mon[34367]: pgmap v390: 97 pgs: 97 active+clean; 54 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 372 op/s 2024-09-21T07:36:23.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 110868 15.36 MB/sec warmup 40 sec latency 12.452 ms 2024-09-21T07:36:24.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 113936 15.44 MB/sec warmup 41 sec latency 7.372 ms 2024-09-21T07:36:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:24 smithi123 ceph-mon[34166]: pgmap v391: 97 pgs: 97 active+clean; 55 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.2 MiB/s wr, 389 op/s 2024-09-21T07:36:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:24 smithi060 ceph-mon[31244]: pgmap v391: 97 pgs: 97 active+clean; 55 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.2 MiB/s wr, 389 op/s 2024-09-21T07:36:24.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:24 smithi187 ceph-mon[34367]: pgmap v391: 97 pgs: 97 active+clean; 55 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.2 MiB/s wr, 389 op/s 2024-09-21T07:36:25.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 117086 15.49 MB/sec warmup 42 sec latency 11.257 ms 2024-09-21T07:36:26.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 119480 15.33 MB/sec warmup 43 sec latency 19.668 ms 2024-09-21T07:36:26.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:26 smithi123 ceph-mon[34166]: pgmap v392: 97 pgs: 97 active+clean; 60 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 284 op/s 2024-09-21T07:36:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:26 smithi060 ceph-mon[31244]: pgmap v392: 97 pgs: 97 active+clean; 60 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 284 op/s 2024-09-21T07:36:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:26 smithi187 ceph-mon[34367]: pgmap v392: 97 pgs: 97 active+clean; 60 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 284 op/s 2024-09-21T07:36:27.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 121797 15.30 MB/sec warmup 44 sec latency 12.018 ms 2024-09-21T07:36:28.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 124631 15.34 MB/sec warmup 45 sec latency 11.610 ms 2024-09-21T07:36:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:28 smithi123 ceph-mon[34166]: pgmap v393: 97 pgs: 97 active+clean; 61 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:28 smithi060 ceph-mon[31244]: pgmap v393: 97 pgs: 97 active+clean; 61 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:28.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:28 smithi187 ceph-mon[34367]: pgmap v393: 97 pgs: 97 active+clean; 61 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:29.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 127791 15.39 MB/sec warmup 46 sec latency 12.023 ms 2024-09-21T07:36:30.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 130182 15.25 MB/sec warmup 47 sec latency 13.569 ms 2024-09-21T07:36:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:30 smithi123 ceph-mon[34166]: pgmap v394: 97 pgs: 97 active+clean; 65 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 246 op/s 2024-09-21T07:36:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:30 smithi060 ceph-mon[31244]: pgmap v394: 97 pgs: 97 active+clean; 65 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 246 op/s 2024-09-21T07:36:30.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:30 smithi187 ceph-mon[34367]: pgmap v394: 97 pgs: 97 active+clean; 65 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 246 op/s 2024-09-21T07:36:31.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 132345 15.22 MB/sec warmup 48 sec latency 44.859 ms 2024-09-21T07:36:32.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 135350 15.26 MB/sec warmup 49 sec latency 9.739 ms 2024-09-21T07:36:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:32 smithi123 ceph-mon[34166]: pgmap v395: 97 pgs: 97 active+clean; 65 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 165 op/s 2024-09-21T07:36:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:32 smithi060 ceph-mon[31244]: pgmap v395: 97 pgs: 97 active+clean; 65 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 165 op/s 2024-09-21T07:36:32.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:32 smithi187 ceph-mon[34367]: pgmap v395: 97 pgs: 97 active+clean; 65 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.2 MiB/s wr, 165 op/s 2024-09-21T07:36:33.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 138516 15.31 MB/sec warmup 50 sec latency 17.977 ms 2024-09-21T07:36:34.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 141297 15.28 MB/sec warmup 51 sec latency 16.054 ms 2024-09-21T07:36:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:34 smithi123 ceph-mon[34166]: pgmap v396: 97 pgs: 97 active+clean; 70 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-09-21T07:36:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:34 smithi060 ceph-mon[31244]: pgmap v396: 97 pgs: 97 active+clean; 70 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-09-21T07:36:34.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:34 smithi187 ceph-mon[34367]: pgmap v396: 97 pgs: 97 active+clean; 70 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-09-21T07:36:35.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 143606 15.21 MB/sec warmup 52 sec latency 15.602 ms 2024-09-21T07:36:36.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 146372 15.20 MB/sec warmup 53 sec latency 17.610 ms 2024-09-21T07:36:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:36 smithi123 ceph-mon[34166]: pgmap v397: 97 pgs: 97 active+clean; 72 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 253 op/s 2024-09-21T07:36:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:36 smithi060 ceph-mon[31244]: pgmap v397: 97 pgs: 97 active+clean; 72 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 253 op/s 2024-09-21T07:36:36.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:36 smithi187 ceph-mon[34367]: pgmap v397: 97 pgs: 97 active+clean; 72 MiB data, 723 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.8 MiB/s wr, 253 op/s 2024-09-21T07:36:37.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 149397 15.26 MB/sec warmup 54 sec latency 12.063 ms 2024-09-21T07:36:37.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:37 smithi123 ceph-mon[34166]: pgmap v398: 97 pgs: 97 active+clean; 73 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:37.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:37 smithi060 ceph-mon[31244]: pgmap v398: 97 pgs: 97 active+clean; 73 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:37 smithi187 ceph-mon[34367]: pgmap v398: 97 pgs: 97 active+clean; 73 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-09-21T07:36:38.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 152509 15.30 MB/sec warmup 55 sec latency 13.157 ms 2024-09-21T07:36:39.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 154985 15.19 MB/sec warmup 56 sec latency 18.898 ms 2024-09-21T07:36:40.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:39 smithi187 ceph-mon[34367]: pgmap v399: 97 pgs: 97 active+clean; 79 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.9 MiB/s wr, 270 op/s 2024-09-21T07:36:40.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 157161 15.16 MB/sec warmup 57 sec latency 11.861 ms 2024-09-21T07:36:40.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:39 smithi123 ceph-mon[34166]: pgmap v399: 97 pgs: 97 active+clean; 79 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.9 MiB/s wr, 270 op/s 2024-09-21T07:36:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:39 smithi060 ceph-mon[31244]: pgmap v399: 97 pgs: 97 active+clean; 79 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.9 MiB/s wr, 270 op/s 2024-09-21T07:36:41.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 160036 15.20 MB/sec warmup 58 sec latency 46.423 ms 2024-09-21T07:36:42.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:41 smithi187 ceph-mon[34367]: pgmap v400: 97 pgs: 97 active+clean; 79 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 201 op/s 2024-09-21T07:36:42.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 163016 15.19 MB/sec warmup 59 sec latency 18.854 ms 2024-09-21T07:36:42.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:41 smithi123 ceph-mon[34166]: pgmap v400: 97 pgs: 97 active+clean; 79 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 201 op/s 2024-09-21T07:36:42.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:41 smithi060 ceph-mon[31244]: pgmap v400: 97 pgs: 97 active+clean; 79 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 201 op/s 2024-09-21T07:36:43.089 INFO:tasks.workunit.client.0.smithi060.stdout: 1 165600 15.13 MB/sec warmup 60 sec latency 14.270 ms 2024-09-21T07:36:44.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:43 smithi187 ceph-mon[34367]: pgmap v401: 97 pgs: 97 active+clean; 80 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-09-21T07:36:44.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 167778 15.11 MB/sec warmup 61 sec latency 12.491 ms 2024-09-21T07:36:44.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:43 smithi123 ceph-mon[34166]: pgmap v401: 97 pgs: 97 active+clean; 80 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-09-21T07:36:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:43 smithi060 ceph-mon[31244]: pgmap v401: 97 pgs: 97 active+clean; 80 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-09-21T07:36:45.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 170704 15.14 MB/sec warmup 62 sec latency 9.392 ms 2024-09-21T07:36:46.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:45 smithi187 ceph-mon[34367]: pgmap v402: 97 pgs: 97 active+clean; 83 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.7 MiB/s wr, 203 op/s 2024-09-21T07:36:46.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 173441 15.11 MB/sec warmup 63 sec latency 91.164 ms 2024-09-21T07:36:46.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:45 smithi123 ceph-mon[34166]: pgmap v402: 97 pgs: 97 active+clean; 83 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.7 MiB/s wr, 203 op/s 2024-09-21T07:36:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:45 smithi060 ceph-mon[31244]: pgmap v402: 97 pgs: 97 active+clean; 83 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.7 MiB/s wr, 203 op/s 2024-09-21T07:36:47.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 175310 15.05 MB/sec warmup 64 sec latency 44.034 ms 2024-09-21T07:36:48.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:47 smithi187 ceph-mon[34367]: pgmap v403: 97 pgs: 97 active+clean; 88 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.0 MiB/s wr, 192 op/s 2024-09-21T07:36:48.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 178042 15.04 MB/sec warmup 65 sec latency 16.516 ms 2024-09-21T07:36:48.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:47 smithi123 ceph-mon[34166]: pgmap v403: 97 pgs: 97 active+clean; 88 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.0 MiB/s wr, 192 op/s 2024-09-21T07:36:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:47 smithi060 ceph-mon[31244]: pgmap v403: 97 pgs: 97 active+clean; 88 MiB data, 796 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.0 MiB/s wr, 192 op/s 2024-09-21T07:36:49.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 181166 15.09 MB/sec warmup 66 sec latency 11.732 ms 2024-09-21T07:36:50.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:49 smithi187 ceph-mon[34367]: pgmap v404: 97 pgs: 97 active+clean; 93 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.0 MiB/s wr, 288 op/s 2024-09-21T07:36:50.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 183673 15.03 MB/sec warmup 67 sec latency 19.983 ms 2024-09-21T07:36:50.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:49 smithi123 ceph-mon[34166]: pgmap v404: 97 pgs: 97 active+clean; 93 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.0 MiB/s wr, 288 op/s 2024-09-21T07:36:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:49 smithi060 ceph-mon[31244]: pgmap v404: 97 pgs: 97 active+clean; 93 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.0 MiB/s wr, 288 op/s 2024-09-21T07:36:51.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 185718 14.96 MB/sec warmup 68 sec latency 24.488 ms 2024-09-21T07:36:52.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:51 smithi187 ceph-mon[34367]: pgmap v405: 97 pgs: 97 active+clean; 93 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 204 op/s 2024-09-21T07:36:52.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 188432 14.99 MB/sec warmup 69 sec latency 74.103 ms 2024-09-21T07:36:52.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:51 smithi123 ceph-mon[34166]: pgmap v405: 97 pgs: 97 active+clean; 93 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 204 op/s 2024-09-21T07:36:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:51 smithi060 ceph-mon[31244]: pgmap v405: 97 pgs: 97 active+clean; 93 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 204 op/s 2024-09-21T07:36:53.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 191547 15.03 MB/sec warmup 70 sec latency 15.818 ms 2024-09-21T07:36:54.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:53 smithi187 ceph-mon[34367]: pgmap v406: 97 pgs: 97 active+clean; 91 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.9 MiB/s wr, 240 op/s 2024-09-21T07:36:54.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 193989 14.94 MB/sec warmup 71 sec latency 13.110 ms 2024-09-21T07:36:54.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:53 smithi123 ceph-mon[34166]: pgmap v406: 97 pgs: 97 active+clean; 91 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.9 MiB/s wr, 240 op/s 2024-09-21T07:36:54.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:53 smithi060 ceph-mon[31244]: pgmap v406: 97 pgs: 97 active+clean; 91 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 2.9 MiB/s wr, 240 op/s 2024-09-21T07:36:55.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 196355 14.93 MB/sec warmup 72 sec latency 14.042 ms 2024-09-21T07:36:56.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:55 smithi187 ceph-mon[34367]: pgmap v407: 97 pgs: 97 active+clean; 94 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 275 op/s 2024-09-21T07:36:56.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 199258 14.96 MB/sec warmup 73 sec latency 12.782 ms 2024-09-21T07:36:56.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:55 smithi123 ceph-mon[34166]: pgmap v407: 97 pgs: 97 active+clean; 94 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 275 op/s 2024-09-21T07:36:56.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:55 smithi060 ceph-mon[31244]: pgmap v407: 97 pgs: 97 active+clean; 94 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 275 op/s 2024-09-21T07:36:57.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 202151 14.99 MB/sec warmup 74 sec latency 68.750 ms 2024-09-21T07:36:58.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:57 smithi187 ceph-mon[34367]: pgmap v408: 97 pgs: 97 active+clean; 98 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:36:58.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 204678 14.92 MB/sec warmup 75 sec latency 13.687 ms 2024-09-21T07:36:58.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:57 smithi123 ceph-mon[34166]: pgmap v408: 97 pgs: 97 active+clean; 98 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:36:58.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:57 smithi060 ceph-mon[31244]: pgmap v408: 97 pgs: 97 active+clean; 98 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:36:59.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 207114 14.94 MB/sec warmup 76 sec latency 16.139 ms 2024-09-21T07:37:00.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:36:59 smithi187 ceph-mon[34367]: pgmap v409: 97 pgs: 97 active+clean; 100 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 346 op/s 2024-09-21T07:37:00.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 209887 14.92 MB/sec warmup 77 sec latency 19.846 ms 2024-09-21T07:37:00.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:36:59 smithi123 ceph-mon[34166]: pgmap v409: 97 pgs: 97 active+clean; 100 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 346 op/s 2024-09-21T07:37:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:36:59 smithi060 ceph-mon[31244]: pgmap v409: 97 pgs: 97 active+clean; 100 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 346 op/s 2024-09-21T07:37:01.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 212910 14.96 MB/sec warmup 78 sec latency 82.992 ms 2024-09-21T07:37:02.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:01 smithi187 ceph-mon[34367]: pgmap v410: 97 pgs: 97 active+clean; 100 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-09-21T07:37:02.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 214584 14.86 MB/sec warmup 79 sec latency 57.835 ms 2024-09-21T07:37:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:01 smithi123 ceph-mon[34166]: pgmap v410: 97 pgs: 97 active+clean; 100 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-09-21T07:37:02.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:01 smithi060 ceph-mon[31244]: pgmap v410: 97 pgs: 97 active+clean; 100 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-09-21T07:37:03.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:37:03.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 217182 14.85 MB/sec warmup 80 sec latency 13.484 ms 2024-09-21T07:37:03.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:37:03.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:37:04.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:03 smithi187 ceph-mon[34367]: pgmap v411: 97 pgs: 97 active+clean; 101 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-09-21T07:37:04.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:37:04.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:37:04.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:37:04.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 220288 14.89 MB/sec warmup 81 sec latency 11.144 ms 2024-09-21T07:37:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:03 smithi123 ceph-mon[34166]: pgmap v411: 97 pgs: 97 active+clean; 101 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-09-21T07:37:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:37:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:37:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:37:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:03 smithi060 ceph-mon[31244]: pgmap v411: 97 pgs: 97 active+clean; 101 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-09-21T07:37:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:37:04.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:37:04.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:37:05.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 223159 14.88 MB/sec warmup 82 sec latency 14.498 ms 2024-09-21T07:37:06.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:05 smithi187 ceph-mon[34367]: pgmap v412: 97 pgs: 97 active+clean; 105 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.0 MiB/s wr, 324 op/s 2024-09-21T07:37:06.090 INFO:tasks.workunit.client.0.smithi060.stdout: 1 225469 14.83 MB/sec warmup 83 sec latency 55.008 ms 2024-09-21T07:37:06.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:05 smithi123 ceph-mon[34166]: pgmap v412: 97 pgs: 97 active+clean; 105 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.0 MiB/s wr, 324 op/s 2024-09-21T07:37:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:05 smithi060 ceph-mon[31244]: pgmap v412: 97 pgs: 97 active+clean; 105 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.0 MiB/s wr, 324 op/s 2024-09-21T07:37:07.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 227597 14.82 MB/sec warmup 84 sec latency 68.216 ms 2024-09-21T07:37:08.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:07 smithi187 ceph-mon[34367]: pgmap v413: 97 pgs: 97 active+clean; 105 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-09-21T07:37:08.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 230716 14.85 MB/sec warmup 85 sec latency 19.444 ms 2024-09-21T07:37:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:07 smithi123 ceph-mon[34166]: pgmap v413: 97 pgs: 97 active+clean; 105 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-09-21T07:37:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:07 smithi060 ceph-mon[31244]: pgmap v413: 97 pgs: 97 active+clean; 105 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-09-21T07:37:09.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 233207 14.79 MB/sec warmup 86 sec latency 12.300 ms 2024-09-21T07:37:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:09 smithi187 ceph-mon[34367]: pgmap v414: 97 pgs: 97 active+clean; 110 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 302 op/s 2024-09-21T07:37:10.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 235398 14.77 MB/sec warmup 87 sec latency 17.138 ms 2024-09-21T07:37:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:09 smithi123 ceph-mon[34166]: pgmap v414: 97 pgs: 97 active+clean; 110 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 302 op/s 2024-09-21T07:37:10.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:09 smithi060 ceph-mon[31244]: pgmap v414: 97 pgs: 97 active+clean; 110 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.0 MiB/s wr, 302 op/s 2024-09-21T07:37:11.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 238276 14.80 MB/sec warmup 88 sec latency 12.164 ms 2024-09-21T07:37:12.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:11 smithi187 ceph-mon[34367]: pgmap v415: 97 pgs: 97 active+clean; 110 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-09-21T07:37:12.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 241216 14.83 MB/sec warmup 89 sec latency 77.872 ms 2024-09-21T07:37:12.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:11 smithi123 ceph-mon[34166]: pgmap v415: 97 pgs: 97 active+clean; 110 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-09-21T07:37:12.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:11 smithi060 ceph-mon[31244]: pgmap v415: 97 pgs: 97 active+clean; 110 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-09-21T07:37:13.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 243681 14.76 MB/sec warmup 90 sec latency 11.011 ms 2024-09-21T07:37:14.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:13 smithi187 ceph-mon[34367]: pgmap v416: 97 pgs: 97 active+clean; 110 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 311 op/s 2024-09-21T07:37:14.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 245941 14.75 MB/sec warmup 91 sec latency 11.376 ms 2024-09-21T07:37:14.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:13 smithi123 ceph-mon[34166]: pgmap v416: 97 pgs: 97 active+clean; 110 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 311 op/s 2024-09-21T07:37:14.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:13 smithi060 ceph-mon[31244]: pgmap v416: 97 pgs: 97 active+clean; 110 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 311 op/s 2024-09-21T07:37:15.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 248915 14.78 MB/sec warmup 92 sec latency 11.374 ms 2024-09-21T07:37:16.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:15 smithi187 ceph-mon[34367]: pgmap v417: 97 pgs: 97 active+clean; 111 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 321 op/s 2024-09-21T07:37:16.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 252110 14.82 MB/sec warmup 93 sec latency 15.892 ms 2024-09-21T07:37:16.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:15 smithi123 ceph-mon[34166]: pgmap v417: 97 pgs: 97 active+clean; 111 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 321 op/s 2024-09-21T07:37:16.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:15 smithi060 ceph-mon[31244]: pgmap v417: 97 pgs: 97 active+clean; 111 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 321 op/s 2024-09-21T07:37:17.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 254309 14.74 MB/sec warmup 94 sec latency 80.735 ms 2024-09-21T07:37:18.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:17 smithi187 ceph-mon[34367]: pgmap v418: 97 pgs: 97 active+clean; 110 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T07:37:18.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 256513 14.73 MB/sec warmup 95 sec latency 15.517 ms 2024-09-21T07:37:18.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:17 smithi123 ceph-mon[34166]: pgmap v418: 97 pgs: 97 active+clean; 110 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T07:37:18.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:17 smithi060 ceph-mon[31244]: pgmap v418: 97 pgs: 97 active+clean; 110 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T07:37:19.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 259433 14.76 MB/sec warmup 96 sec latency 13.351 ms 2024-09-21T07:37:20.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:19 smithi187 ceph-mon[34367]: pgmap v419: 97 pgs: 97 active+clean; 118 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 338 op/s 2024-09-21T07:37:20.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 262584 14.79 MB/sec warmup 97 sec latency 12.883 ms 2024-09-21T07:37:20.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:19 smithi123 ceph-mon[34166]: pgmap v419: 97 pgs: 97 active+clean; 118 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 338 op/s 2024-09-21T07:37:20.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:19 smithi060 ceph-mon[31244]: pgmap v419: 97 pgs: 97 active+clean; 118 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 338 op/s 2024-09-21T07:37:21.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 264954 14.73 MB/sec warmup 98 sec latency 16.073 ms 2024-09-21T07:37:22.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 266841 14.70 MB/sec warmup 99 sec latency 96.677 ms 2024-09-21T07:37:22.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:21 smithi123 ceph-mon[34166]: pgmap v420: 97 pgs: 97 active+clean; 118 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 239 op/s 2024-09-21T07:37:22.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:21 smithi060 ceph-mon[31244]: pgmap v420: 97 pgs: 97 active+clean; 118 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 239 op/s 2024-09-21T07:37:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:21 smithi187 ceph-mon[34367]: pgmap v420: 97 pgs: 97 active+clean; 118 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 239 op/s 2024-09-21T07:37:23.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 269805 14.74 MB/sec warmup 100 sec latency 40.073 ms 2024-09-21T07:37:24.091 INFO:tasks.workunit.client.0.smithi060.stdout: 1 272481 14.71 MB/sec warmup 101 sec latency 12.284 ms 2024-09-21T07:37:24.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:23 smithi123 ceph-mon[34166]: pgmap v421: 97 pgs: 97 active+clean; 118 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-21T07:37:24.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:23 smithi060 ceph-mon[31244]: pgmap v421: 97 pgs: 97 active+clean; 118 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-21T07:37:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:23 smithi187 ceph-mon[34367]: pgmap v421: 97 pgs: 97 active+clean; 118 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-21T07:37:25.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 274837 14.69 MB/sec warmup 102 sec latency 18.965 ms 2024-09-21T07:37:26.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 277520 14.69 MB/sec warmup 103 sec latency 12.195 ms 2024-09-21T07:37:26.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:25 smithi123 ceph-mon[34166]: pgmap v422: 97 pgs: 97 active+clean; 122 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 292 op/s 2024-09-21T07:37:26.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:25 smithi060 ceph-mon[31244]: pgmap v422: 97 pgs: 97 active+clean; 122 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 292 op/s 2024-09-21T07:37:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:25 smithi187 ceph-mon[34367]: pgmap v422: 97 pgs: 97 active+clean; 122 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 292 op/s 2024-09-21T07:37:27.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 280518 14.72 MB/sec warmup 104 sec latency 46.253 ms 2024-09-21T07:37:28.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 283170 14.71 MB/sec warmup 105 sec latency 22.752 ms 2024-09-21T07:37:28.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:27 smithi123 ceph-mon[34166]: pgmap v423: 97 pgs: 97 active+clean; 122 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2024-09-21T07:37:28.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:27 smithi060 ceph-mon[31244]: pgmap v423: 97 pgs: 97 active+clean; 122 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2024-09-21T07:37:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:27 smithi187 ceph-mon[34367]: pgmap v423: 97 pgs: 97 active+clean; 122 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2024-09-21T07:37:29.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 285424 14.68 MB/sec warmup 106 sec latency 13.329 ms 2024-09-21T07:37:30.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 288159 14.68 MB/sec warmup 107 sec latency 12.557 ms 2024-09-21T07:37:30.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:29 smithi123 ceph-mon[34166]: pgmap v424: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 344 op/s 2024-09-21T07:37:30.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:29 smithi060 ceph-mon[31244]: pgmap v424: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 344 op/s 2024-09-21T07:37:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:29 smithi187 ceph-mon[34367]: pgmap v424: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 344 op/s 2024-09-21T07:37:31.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 291302 14.71 MB/sec warmup 108 sec latency 7.796 ms 2024-09-21T07:37:32.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 294213 14.71 MB/sec warmup 109 sec latency 59.816 ms 2024-09-21T07:37:32.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:31 smithi123 ceph-mon[34166]: pgmap v425: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 238 op/s 2024-09-21T07:37:32.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:31 smithi060 ceph-mon[31244]: pgmap v425: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 238 op/s 2024-09-21T07:37:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:31 smithi187 ceph-mon[34367]: pgmap v425: 97 pgs: 97 active+clean; 126 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 238 op/s 2024-09-21T07:37:33.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 296129 14.67 MB/sec warmup 110 sec latency 92.277 ms 2024-09-21T07:37:34.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 298776 14.66 MB/sec warmup 111 sec latency 12.473 ms 2024-09-21T07:37:34.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:33 smithi123 ceph-mon[34166]: pgmap v426: 97 pgs: 97 active+clean; 130 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 320 op/s 2024-09-21T07:37:34.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:33 smithi060 ceph-mon[31244]: pgmap v426: 97 pgs: 97 active+clean; 130 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 320 op/s 2024-09-21T07:37:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:33 smithi187 ceph-mon[34367]: pgmap v426: 97 pgs: 97 active+clean; 130 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 320 op/s 2024-09-21T07:37:35.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 301815 14.70 MB/sec warmup 112 sec latency 17.637 ms 2024-09-21T07:37:36.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 304689 14.69 MB/sec warmup 113 sec latency 11.339 ms 2024-09-21T07:37:36.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:35 smithi123 ceph-mon[34166]: pgmap v427: 97 pgs: 97 active+clean; 130 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 306 op/s 2024-09-21T07:37:36.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:35 smithi060 ceph-mon[31244]: pgmap v427: 97 pgs: 97 active+clean; 130 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 306 op/s 2024-09-21T07:37:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:35 smithi187 ceph-mon[34367]: pgmap v427: 97 pgs: 97 active+clean; 130 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 306 op/s 2024-09-21T07:37:37.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 307107 14.66 MB/sec warmup 114 sec latency 19.598 ms 2024-09-21T07:37:38.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 309019 14.65 MB/sec warmup 115 sec latency 163.995 ms 2024-09-21T07:37:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:37 smithi123 ceph-mon[34166]: pgmap v428: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-21T07:37:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:37 smithi060 ceph-mon[31244]: pgmap v428: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-21T07:37:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:37 smithi187 ceph-mon[34367]: pgmap v428: 97 pgs: 97 active+clean; 132 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 289 op/s 2024-09-21T07:37:39.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 312230 14.67 MB/sec warmup 116 sec latency 14.945 ms 2024-09-21T07:37:40.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 314656 14.63 MB/sec warmup 117 sec latency 16.130 ms 2024-09-21T07:37:40.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:39 smithi123 ceph-mon[34166]: pgmap v429: 97 pgs: 97 active+clean; 133 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 320 op/s 2024-09-21T07:37:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:39 smithi060 ceph-mon[31244]: pgmap v429: 97 pgs: 97 active+clean; 133 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 320 op/s 2024-09-21T07:37:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:39 smithi187 ceph-mon[34367]: pgmap v429: 97 pgs: 97 active+clean; 133 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 320 op/s 2024-09-21T07:37:41.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 316962 14.62 MB/sec warmup 118 sec latency 13.828 ms 2024-09-21T07:37:42.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 319848 14.64 MB/sec warmup 119 sec latency 11.322 ms 2024-09-21T07:37:42.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:41 smithi123 ceph-mon[34166]: pgmap v430: 97 pgs: 97 active+clean; 133 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 224 op/s 2024-09-21T07:37:42.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:41 smithi060 ceph-mon[31244]: pgmap v430: 97 pgs: 97 active+clean; 133 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 224 op/s 2024-09-21T07:37:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:41 smithi187 ceph-mon[34367]: pgmap v430: 97 pgs: 97 active+clean; 133 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 224 op/s 2024-09-21T07:37:44.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 325091 11.43 MB/sec execute 1 sec latency 86.030 ms 2024-09-21T07:37:44.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:43 smithi123 ceph-mon[34166]: pgmap v431: 97 pgs: 97 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 275 op/s 2024-09-21T07:37:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:43 smithi060 ceph-mon[31244]: pgmap v431: 97 pgs: 97 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 275 op/s 2024-09-21T07:37:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:43 smithi187 ceph-mon[34367]: pgmap v431: 97 pgs: 97 active+clean; 134 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.8 MiB/s wr, 275 op/s 2024-09-21T07:37:45.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 327287 12.28 MB/sec execute 2 sec latency 13.120 ms 2024-09-21T07:37:46.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 330289 14.28 MB/sec execute 3 sec latency 11.955 ms 2024-09-21T07:37:46.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:45 smithi123 ceph-mon[34166]: pgmap v432: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 264 op/s 2024-09-21T07:37:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:45 smithi060 ceph-mon[31244]: pgmap v432: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 264 op/s 2024-09-21T07:37:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:45 smithi187 ceph-mon[34367]: pgmap v432: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 264 op/s 2024-09-21T07:37:47.092 INFO:tasks.workunit.client.0.smithi060.stdout: 1 333261 14.34 MB/sec execute 4 sec latency 11.958 ms 2024-09-21T07:37:48.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 334864 13.41 MB/sec execute 5 sec latency 62.440 ms 2024-09-21T07:37:48.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:47 smithi123 ceph-mon[34166]: pgmap v433: 97 pgs: 97 active+clean; 144 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-09-21T07:37:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:47 smithi060 ceph-mon[31244]: pgmap v433: 97 pgs: 97 active+clean; 144 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-09-21T07:37:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:47 smithi187 ceph-mon[34367]: pgmap v433: 97 pgs: 97 active+clean; 144 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-09-21T07:37:49.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 337643 13.53 MB/sec execute 6 sec latency 13.715 ms 2024-09-21T07:37:50.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 340775 14.27 MB/sec execute 7 sec latency 11.899 ms 2024-09-21T07:37:50.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:49 smithi123 ceph-mon[34166]: pgmap v434: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 286 op/s 2024-09-21T07:37:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:49 smithi060 ceph-mon[31244]: pgmap v434: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 286 op/s 2024-09-21T07:37:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:49 smithi187 ceph-mon[34367]: pgmap v434: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.9 MiB/s wr, 286 op/s 2024-09-21T07:37:51.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 343529 14.10 MB/sec execute 8 sec latency 19.504 ms 2024-09-21T07:37:52.070 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:51 smithi187 ceph-mon[34367]: pgmap v435: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-21T07:37:52.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 345982 13.87 MB/sec execute 9 sec latency 16.168 ms 2024-09-21T07:37:52.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:51 smithi123 ceph-mon[34166]: pgmap v435: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-21T07:37:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:51 smithi060 ceph-mon[31244]: pgmap v435: 97 pgs: 97 active+clean; 141 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-21T07:37:53.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 347938 13.81 MB/sec execute 10 sec latency 127.354 ms 2024-09-21T07:37:54.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 351116 14.17 MB/sec execute 11 sec latency 11.499 ms 2024-09-21T07:37:54.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:53 smithi123 ceph-mon[34166]: pgmap v436: 97 pgs: 97 active+clean; 146 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 335 op/s 2024-09-21T07:37:54.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:53 smithi060 ceph-mon[31244]: pgmap v436: 97 pgs: 97 active+clean; 146 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 335 op/s 2024-09-21T07:37:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:53 smithi187 ceph-mon[34367]: pgmap v436: 97 pgs: 97 active+clean; 146 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 335 op/s 2024-09-21T07:37:55.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 353613 13.73 MB/sec execute 12 sec latency 11.390 ms 2024-09-21T07:37:56.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 355855 13.75 MB/sec execute 13 sec latency 13.181 ms 2024-09-21T07:37:56.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:55 smithi123 ceph-mon[34166]: pgmap v437: 97 pgs: 97 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 319 op/s 2024-09-21T07:37:56.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:55 smithi060 ceph-mon[31244]: pgmap v437: 97 pgs: 97 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 319 op/s 2024-09-21T07:37:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:55 smithi187 ceph-mon[34367]: pgmap v437: 97 pgs: 97 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 319 op/s 2024-09-21T07:37:57.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 358694 13.99 MB/sec execute 14 sec latency 12.864 ms 2024-09-21T07:37:58.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 361177 13.89 MB/sec execute 15 sec latency 61.500 ms 2024-09-21T07:37:58.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:57 smithi123 ceph-mon[34166]: pgmap v438: 97 pgs: 97 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 268 op/s 2024-09-21T07:37:58.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:57 smithi060 ceph-mon[31244]: pgmap v438: 97 pgs: 97 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 268 op/s 2024-09-21T07:37:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:57 smithi187 ceph-mon[34367]: pgmap v438: 97 pgs: 97 active+clean; 145 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 268 op/s 2024-09-21T07:37:59.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 363685 13.77 MB/sec execute 16 sec latency 12.004 ms 2024-09-21T07:38:00.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 366223 13.81 MB/sec execute 17 sec latency 16.042 ms 2024-09-21T07:38:00.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:37:59 smithi123 ceph-mon[34166]: pgmap v439: 97 pgs: 97 active+clean; 150 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.8 MiB/s wr, 290 op/s 2024-09-21T07:38:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:37:59 smithi060 ceph-mon[31244]: pgmap v439: 97 pgs: 97 active+clean; 150 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.8 MiB/s wr, 290 op/s 2024-09-21T07:38:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:37:59 smithi187 ceph-mon[34367]: pgmap v439: 97 pgs: 97 active+clean; 150 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.8 MiB/s wr, 290 op/s 2024-09-21T07:38:01.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 369273 14.06 MB/sec execute 18 sec latency 12.969 ms 2024-09-21T07:38:02.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 372259 14.09 MB/sec execute 19 sec latency 11.671 ms 2024-09-21T07:38:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:01 smithi123 ceph-mon[34166]: pgmap v440: 97 pgs: 97 active+clean; 150 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-09-21T07:38:02.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:01 smithi060 ceph-mon[31244]: pgmap v440: 97 pgs: 97 active+clean; 150 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-09-21T07:38:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:01 smithi187 ceph-mon[34367]: pgmap v440: 97 pgs: 97 active+clean; 150 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-09-21T07:38:03.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 374040 13.87 MB/sec execute 20 sec latency 73.443 ms 2024-09-21T07:38:03.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:02 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:38:03.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:02 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:38:03.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:02 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:38:04.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 376641 13.88 MB/sec execute 21 sec latency 15.779 ms 2024-09-21T07:38:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:03 smithi060 ceph-mon[31244]: pgmap v441: 97 pgs: 97 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.9 MiB/s wr, 291 op/s 2024-09-21T07:38:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:38:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:38:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:38:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:03 smithi187 ceph-mon[34367]: pgmap v441: 97 pgs: 97 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.9 MiB/s wr, 291 op/s 2024-09-21T07:38:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:38:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:38:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:38:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:03 smithi123 ceph-mon[34166]: pgmap v441: 97 pgs: 97 active+clean; 151 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.9 MiB/s wr, 291 op/s 2024-09-21T07:38:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:38:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:38:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:38:05.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 379787 14.10 MB/sec execute 22 sec latency 11.143 ms 2024-09-21T07:38:06.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 382340 13.98 MB/sec execute 23 sec latency 16.045 ms 2024-09-21T07:38:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:05 smithi060 ceph-mon[31244]: pgmap v442: 97 pgs: 97 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 250 op/s 2024-09-21T07:38:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:05 smithi187 ceph-mon[34367]: pgmap v442: 97 pgs: 97 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 250 op/s 2024-09-21T07:38:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:05 smithi123 ceph-mon[34166]: pgmap v442: 97 pgs: 97 active+clean; 154 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 250 op/s 2024-09-21T07:38:07.093 INFO:tasks.workunit.client.0.smithi060.stdout: 1 384514 13.95 MB/sec execute 24 sec latency 12.565 ms 2024-09-21T07:38:08.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 386969 13.94 MB/sec execute 25 sec latency 75.669 ms 2024-09-21T07:38:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:07 smithi060 ceph-mon[31244]: pgmap v443: 97 pgs: 97 active+clean; 158 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-09-21T07:38:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:07 smithi187 ceph-mon[34367]: pgmap v443: 97 pgs: 97 active+clean; 158 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-09-21T07:38:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:07 smithi123 ceph-mon[34166]: pgmap v443: 97 pgs: 97 active+clean; 158 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 297 op/s 2024-09-21T07:38:09.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 389442 13.84 MB/sec execute 26 sec latency 16.692 ms 2024-09-21T07:38:10.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 391467 13.71 MB/sec execute 27 sec latency 14.142 ms 2024-09-21T07:38:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:09 smithi187 ceph-mon[34367]: pgmap v444: 97 pgs: 97 active+clean; 160 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:38:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:09 smithi123 ceph-mon[34166]: pgmap v444: 97 pgs: 97 active+clean; 160 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:38:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:09 smithi060 ceph-mon[31244]: pgmap v444: 97 pgs: 97 active+clean; 160 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:38:11.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 394230 13.82 MB/sec execute 28 sec latency 14.401 ms 2024-09-21T07:38:12.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 397428 13.96 MB/sec execute 29 sec latency 21.239 ms 2024-09-21T07:38:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:11 smithi187 ceph-mon[34367]: pgmap v445: 97 pgs: 97 active+clean; 160 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 215 op/s 2024-09-21T07:38:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:11 smithi123 ceph-mon[34166]: pgmap v445: 97 pgs: 97 active+clean; 160 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 215 op/s 2024-09-21T07:38:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:11 smithi060 ceph-mon[31244]: pgmap v445: 97 pgs: 97 active+clean; 160 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 215 op/s 2024-09-21T07:38:13.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 399265 13.72 MB/sec execute 30 sec latency 101.118 ms 2024-09-21T07:38:14.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 401610 13.73 MB/sec execute 31 sec latency 30.944 ms 2024-09-21T07:38:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:13 smithi187 ceph-mon[34367]: pgmap v446: 97 pgs: 97 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 304 op/s 2024-09-21T07:38:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:13 smithi123 ceph-mon[34166]: pgmap v446: 97 pgs: 97 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 304 op/s 2024-09-21T07:38:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:13 smithi060 ceph-mon[31244]: pgmap v446: 97 pgs: 97 active+clean; 164 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.0 MiB/s wr, 304 op/s 2024-09-21T07:38:15.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 404712 13.88 MB/sec execute 32 sec latency 8.001 ms 2024-09-21T07:38:16.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 407738 13.91 MB/sec execute 33 sec latency 11.140 ms 2024-09-21T07:38:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:15 smithi187 ceph-mon[34367]: pgmap v447: 97 pgs: 97 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:38:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:15 smithi123 ceph-mon[34166]: pgmap v447: 97 pgs: 97 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:38:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:15 smithi060 ceph-mon[31244]: pgmap v447: 97 pgs: 97 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:38:17.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 410295 13.84 MB/sec execute 34 sec latency 12.688 ms 2024-09-21T07:38:18.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 412418 13.81 MB/sec execute 35 sec latency 22.531 ms 2024-09-21T07:38:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:17 smithi187 ceph-mon[34367]: pgmap v448: 97 pgs: 97 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 262 op/s 2024-09-21T07:38:18.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:17 smithi123 ceph-mon[34166]: pgmap v448: 97 pgs: 97 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 262 op/s 2024-09-21T07:38:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:17 smithi060 ceph-mon[31244]: pgmap v448: 97 pgs: 97 active+clean; 165 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 262 op/s 2024-09-21T07:38:19.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 415286 13.93 MB/sec execute 36 sec latency 50.998 ms 2024-09-21T07:38:20.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 417809 13.86 MB/sec execute 37 sec latency 23.460 ms 2024-09-21T07:38:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:19 smithi187 ceph-mon[34367]: pgmap v449: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:38:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:19 smithi123 ceph-mon[34166]: pgmap v449: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:38:20.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:19 smithi060 ceph-mon[31244]: pgmap v449: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:38:21.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 420106 13.84 MB/sec execute 38 sec latency 12.629 ms 2024-09-21T07:38:22.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 422808 13.85 MB/sec execute 39 sec latency 17.642 ms 2024-09-21T07:38:22.150 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:21 smithi123 ceph-mon[34166]: pgmap v450: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 247 op/s 2024-09-21T07:38:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:21 smithi187 ceph-mon[34367]: pgmap v450: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 247 op/s 2024-09-21T07:38:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:21 smithi060 ceph-mon[31244]: pgmap v450: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 247 op/s 2024-09-21T07:38:23.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 425922 13.97 MB/sec execute 40 sec latency 32.560 ms 2024-09-21T07:38:24.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 428112 13.81 MB/sec execute 41 sec latency 104.766 ms 2024-09-21T07:38:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:23 smithi187 ceph-mon[34367]: pgmap v451: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 282 op/s 2024-09-21T07:38:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:23 smithi123 ceph-mon[34166]: pgmap v451: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 282 op/s 2024-09-21T07:38:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:23 smithi060 ceph-mon[31244]: pgmap v451: 97 pgs: 97 active+clean; 167 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 282 op/s 2024-09-21T07:38:25.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 430454 13.82 MB/sec execute 42 sec latency 12.040 ms 2024-09-21T07:38:26.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 433427 13.90 MB/sec execute 43 sec latency 22.935 ms 2024-09-21T07:38:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:25 smithi187 ceph-mon[34367]: pgmap v452: 97 pgs: 97 active+clean; 171 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 272 op/s 2024-09-21T07:38:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:25 smithi123 ceph-mon[34166]: pgmap v452: 97 pgs: 97 active+clean; 171 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 272 op/s 2024-09-21T07:38:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:25 smithi060 ceph-mon[31244]: pgmap v452: 97 pgs: 97 active+clean; 171 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 272 op/s 2024-09-21T07:38:27.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 436557 14.01 MB/sec execute 44 sec latency 13.988 ms 2024-09-21T07:38:28.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 439318 13.98 MB/sec execute 45 sec latency 12.250 ms 2024-09-21T07:38:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:27 smithi187 ceph-mon[34367]: pgmap v453: 97 pgs: 97 active+clean; 172 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 260 op/s 2024-09-21T07:38:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:27 smithi123 ceph-mon[34166]: pgmap v453: 97 pgs: 97 active+clean; 172 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 260 op/s 2024-09-21T07:38:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:27 smithi060 ceph-mon[31244]: pgmap v453: 97 pgs: 97 active+clean; 172 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 260 op/s 2024-09-21T07:38:29.094 INFO:tasks.workunit.client.0.smithi060.stdout: 1 441258 13.93 MB/sec execute 46 sec latency 61.380 ms 2024-09-21T07:38:30.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 443965 13.93 MB/sec execute 47 sec latency 11.787 ms 2024-09-21T07:38:30.174 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:29 smithi060 ceph-mon[31244]: pgmap v454: 97 pgs: 97 active+clean; 174 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 303 op/s 2024-09-21T07:38:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:29 smithi187 ceph-mon[34367]: pgmap v454: 97 pgs: 97 active+clean; 174 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 303 op/s 2024-09-21T07:38:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:29 smithi123 ceph-mon[34166]: pgmap v454: 97 pgs: 97 active+clean; 174 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 303 op/s 2024-09-21T07:38:31.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 447031 14.01 MB/sec execute 48 sec latency 50.151 ms 2024-09-21T07:38:32.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 449445 13.91 MB/sec execute 49 sec latency 12.692 ms 2024-09-21T07:38:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:31 smithi187 ceph-mon[34367]: pgmap v455: 97 pgs: 97 active+clean; 174 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 205 op/s 2024-09-21T07:38:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:31 smithi123 ceph-mon[34166]: pgmap v455: 97 pgs: 97 active+clean; 174 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 205 op/s 2024-09-21T07:38:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:31 smithi060 ceph-mon[31244]: pgmap v455: 97 pgs: 97 active+clean; 174 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 205 op/s 2024-09-21T07:38:33.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 451779 13.90 MB/sec execute 50 sec latency 12.994 ms 2024-09-21T07:38:34.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 454424 13.96 MB/sec execute 51 sec latency 69.011 ms 2024-09-21T07:38:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:33 smithi187 ceph-mon[34367]: pgmap v456: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 315 op/s 2024-09-21T07:38:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:33 smithi123 ceph-mon[34166]: pgmap v456: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 315 op/s 2024-09-21T07:38:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:33 smithi060 ceph-mon[31244]: pgmap v456: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 315 op/s 2024-09-21T07:38:35.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 457412 13.97 MB/sec execute 52 sec latency 17.352 ms 2024-09-21T07:38:36.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 458999 14.20 MB/sec execute 53 sec latency 41.733 ms 2024-09-21T07:38:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:35 smithi187 ceph-mon[34367]: pgmap v457: 97 pgs: 97 active+clean; 178 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 300 op/s 2024-09-21T07:38:36.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:35 smithi123 ceph-mon[34166]: pgmap v457: 97 pgs: 97 active+clean; 178 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 300 op/s 2024-09-21T07:38:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:35 smithi060 ceph-mon[31244]: pgmap v457: 97 pgs: 97 active+clean; 178 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 300 op/s 2024-09-21T07:38:37.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 462212 14.28 MB/sec execute 54 sec latency 7.754 ms 2024-09-21T07:38:38.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 464877 14.26 MB/sec execute 55 sec latency 34.694 ms 2024-09-21T07:38:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:37 smithi187 ceph-mon[34367]: pgmap v458: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 276 op/s 2024-09-21T07:38:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:37 smithi123 ceph-mon[34166]: pgmap v458: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 276 op/s 2024-09-21T07:38:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:37 smithi060 ceph-mon[31244]: pgmap v458: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 276 op/s 2024-09-21T07:38:39.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 466871 14.21 MB/sec execute 56 sec latency 43.500 ms 2024-09-21T07:38:40.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 469671 14.21 MB/sec execute 57 sec latency 13.109 ms 2024-09-21T07:38:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:39 smithi187 ceph-mon[34367]: pgmap v459: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 329 op/s 2024-09-21T07:38:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:39 smithi123 ceph-mon[34166]: pgmap v459: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 329 op/s 2024-09-21T07:38:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:39 smithi060 ceph-mon[31244]: pgmap v459: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 329 op/s 2024-09-21T07:38:41.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 472880 14.29 MB/sec execute 58 sec latency 7.079 ms 2024-09-21T07:38:42.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 476066 14.34 MB/sec execute 59 sec latency 19.499 ms 2024-09-21T07:38:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:41 smithi187 ceph-mon[34367]: pgmap v460: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-09-21T07:38:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:41 smithi123 ceph-mon[34166]: pgmap v460: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-09-21T07:38:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:41 smithi060 ceph-mon[31244]: pgmap v460: 97 pgs: 97 active+clean; 181 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 267 op/s 2024-09-21T07:38:43.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 478523 14.25 MB/sec execute 60 sec latency 17.062 ms 2024-09-21T07:38:44.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 480459 14.22 MB/sec execute 61 sec latency 101.099 ms 2024-09-21T07:38:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:43 smithi187 ceph-mon[34367]: pgmap v461: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 333 op/s 2024-09-21T07:38:44.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:43 smithi123 ceph-mon[34166]: pgmap v461: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 333 op/s 2024-09-21T07:38:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:43 smithi060 ceph-mon[31244]: pgmap v461: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 333 op/s 2024-09-21T07:38:45.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 483611 14.30 MB/sec execute 62 sec latency 15.038 ms 2024-09-21T07:38:46.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 486911 14.35 MB/sec execute 63 sec latency 15.138 ms 2024-09-21T07:38:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:45 smithi187 ceph-mon[34367]: pgmap v462: 97 pgs: 97 active+clean; 173 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-09-21T07:38:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:45 smithi123 ceph-mon[34166]: pgmap v462: 97 pgs: 97 active+clean; 173 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-09-21T07:38:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:45 smithi060 ceph-mon[31244]: pgmap v462: 97 pgs: 97 active+clean; 173 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-09-21T07:38:47.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 489928 14.35 MB/sec execute 64 sec latency 11.417 ms 2024-09-21T07:38:48.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 492677 14.33 MB/sec execute 65 sec latency 29.214 ms 2024-09-21T07:38:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:47 smithi187 ceph-mon[34367]: pgmap v463: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 289 op/s 2024-09-21T07:38:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:47 smithi123 ceph-mon[34166]: pgmap v463: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 289 op/s 2024-09-21T07:38:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:47 smithi060 ceph-mon[31244]: pgmap v463: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 289 op/s 2024-09-21T07:38:49.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 494642 14.30 MB/sec execute 66 sec latency 48.749 ms 2024-09-21T07:38:50.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 497741 14.37 MB/sec execute 67 sec latency 20.043 ms 2024-09-21T07:38:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:49 smithi187 ceph-mon[34367]: pgmap v464: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 290 op/s 2024-09-21T07:38:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:49 smithi123 ceph-mon[34166]: pgmap v464: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 290 op/s 2024-09-21T07:38:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:49 smithi060 ceph-mon[31244]: pgmap v464: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 290 op/s 2024-09-21T07:38:51.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 500762 14.37 MB/sec execute 68 sec latency 11.391 ms 2024-09-21T07:38:52.095 INFO:tasks.workunit.client.0.smithi060.stdout: 1 503499 14.35 MB/sec execute 69 sec latency 12.139 ms 2024-09-21T07:38:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:51 smithi187 ceph-mon[34367]: pgmap v465: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2024-09-21T07:38:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:51 smithi123 ceph-mon[34166]: pgmap v465: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2024-09-21T07:38:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:51 smithi060 ceph-mon[31244]: pgmap v465: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2024-09-21T07:38:53.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 505926 14.37 MB/sec execute 70 sec latency 14.088 ms 2024-09-21T07:38:54.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 508506 14.37 MB/sec execute 71 sec latency 64.164 ms 2024-09-21T07:38:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:53 smithi187 ceph-mon[34367]: pgmap v466: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 4.1 MiB/s wr, 309 op/s 2024-09-21T07:38:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:53 smithi123 ceph-mon[34166]: pgmap v466: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 4.1 MiB/s wr, 309 op/s 2024-09-21T07:38:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:53 smithi060 ceph-mon[31244]: pgmap v466: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 4.1 MiB/s wr, 309 op/s 2024-09-21T07:38:55.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 511584 14.41 MB/sec execute 72 sec latency 15.264 ms 2024-09-21T07:38:56.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 514066 14.34 MB/sec execute 73 sec latency 11.045 ms 2024-09-21T07:38:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:55 smithi187 ceph-mon[34367]: pgmap v467: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.9 MiB/s wr, 261 op/s 2024-09-21T07:38:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:55 smithi123 ceph-mon[34166]: pgmap v467: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.9 MiB/s wr, 261 op/s 2024-09-21T07:38:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:55 smithi060 ceph-mon[31244]: pgmap v467: 97 pgs: 97 active+clean; 179 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.9 MiB/s wr, 261 op/s 2024-09-21T07:38:57.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 516654 14.37 MB/sec execute 74 sec latency 21.408 ms 2024-09-21T07:38:58.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 519475 14.37 MB/sec execute 75 sec latency 12.155 ms 2024-09-21T07:38:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:57 smithi187 ceph-mon[34367]: pgmap v468: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 3.8 MiB/s wr, 254 op/s 2024-09-21T07:38:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:57 smithi123 ceph-mon[34166]: pgmap v468: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 3.8 MiB/s wr, 254 op/s 2024-09-21T07:38:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:57 smithi060 ceph-mon[31244]: pgmap v468: 97 pgs: 97 active+clean; 178 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 3.8 MiB/s wr, 254 op/s 2024-09-21T07:38:59.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 522517 14.43 MB/sec execute 76 sec latency 29.856 ms 2024-09-21T07:39:00.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 524929 14.38 MB/sec execute 77 sec latency 76.783 ms 2024-09-21T07:39:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:38:59 smithi187 ceph-mon[34367]: pgmap v469: 97 pgs: 97 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-21T07:39:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:38:59 smithi123 ceph-mon[34166]: pgmap v469: 97 pgs: 97 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-21T07:39:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:38:59 smithi060 ceph-mon[31244]: pgmap v469: 97 pgs: 97 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-21T07:39:01.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 527323 14.37 MB/sec execute 78 sec latency 16.327 ms 2024-09-21T07:39:02.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 529988 14.37 MB/sec execute 79 sec latency 11.532 ms 2024-09-21T07:39:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:01 smithi187 ceph-mon[34367]: pgmap v470: 97 pgs: 97 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 3.1 MiB/s wr, 245 op/s 2024-09-21T07:39:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:01 smithi123 ceph-mon[34166]: pgmap v470: 97 pgs: 97 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 3.1 MiB/s wr, 245 op/s 2024-09-21T07:39:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:01 smithi060 ceph-mon[31244]: pgmap v470: 97 pgs: 97 active+clean; 183 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 3.1 MiB/s wr, 245 op/s 2024-09-21T07:39:03.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 533172 14.42 MB/sec execute 80 sec latency 16.136 ms 2024-09-21T07:39:04.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 536075 14.41 MB/sec execute 81 sec latency 11.690 ms 2024-09-21T07:39:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:03 smithi187 ceph-mon[34367]: pgmap v471: 97 pgs: 97 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.9 MiB/s wr, 280 op/s 2024-09-21T07:39:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:39:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:03 smithi123 ceph-mon[34166]: pgmap v471: 97 pgs: 97 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.9 MiB/s wr, 280 op/s 2024-09-21T07:39:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:39:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:03 smithi060 ceph-mon[31244]: pgmap v471: 97 pgs: 97 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 3.9 MiB/s wr, 280 op/s 2024-09-21T07:39:04.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:39:04.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:39:04.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:39:04.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:39:05.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 538122 14.37 MB/sec execute 82 sec latency 64.522 ms 2024-09-21T07:39:06.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 540712 14.37 MB/sec execute 83 sec latency 21.923 ms 2024-09-21T07:39:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:05 smithi187 ceph-mon[34367]: pgmap v472: 97 pgs: 97 active+clean; 185 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-09-21T07:39:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:05 smithi123 ceph-mon[34166]: pgmap v472: 97 pgs: 97 active+clean; 185 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-09-21T07:39:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:05 smithi060 ceph-mon[31244]: pgmap v472: 97 pgs: 97 active+clean; 185 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-09-21T07:39:07.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 543893 14.42 MB/sec execute 84 sec latency 15.265 ms 2024-09-21T07:39:08.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 546884 14.42 MB/sec execute 85 sec latency 16.203 ms 2024-09-21T07:39:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:07 smithi187 ceph-mon[34367]: pgmap v473: 97 pgs: 97 active+clean; 186 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.6 MiB/s wr, 265 op/s 2024-09-21T07:39:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:07 smithi123 ceph-mon[34166]: pgmap v473: 97 pgs: 97 active+clean; 186 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.6 MiB/s wr, 265 op/s 2024-09-21T07:39:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:07 smithi060 ceph-mon[31244]: pgmap v473: 97 pgs: 97 active+clean; 186 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.6 MiB/s wr, 265 op/s 2024-09-21T07:39:09.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 549525 14.39 MB/sec execute 86 sec latency 11.244 ms 2024-09-21T07:39:10.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 551346 14.37 MB/sec execute 87 sec latency 88.038 ms 2024-09-21T07:39:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:09 smithi187 ceph-mon[34367]: pgmap v474: 97 pgs: 97 active+clean; 189 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 328 op/s 2024-09-21T07:39:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:09 smithi123 ceph-mon[34166]: pgmap v474: 97 pgs: 97 active+clean; 189 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 328 op/s 2024-09-21T07:39:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:09 smithi060 ceph-mon[31244]: pgmap v474: 97 pgs: 97 active+clean; 189 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.2 MiB/s wr, 328 op/s 2024-09-21T07:39:11.096 INFO:tasks.workunit.client.0.smithi060.stdout: 1 554299 14.40 MB/sec execute 88 sec latency 22.431 ms 2024-09-21T07:39:12.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 556762 14.35 MB/sec execute 89 sec latency 12.837 ms 2024-09-21T07:39:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:11 smithi187 ceph-mon[34367]: pgmap v475: 97 pgs: 97 active+clean; 189 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 3.2 MiB/s wr, 223 op/s 2024-09-21T07:39:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:11 smithi123 ceph-mon[34166]: pgmap v475: 97 pgs: 97 active+clean; 189 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 3.2 MiB/s wr, 223 op/s 2024-09-21T07:39:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:11 smithi060 ceph-mon[31244]: pgmap v475: 97 pgs: 97 active+clean; 189 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 3.2 MiB/s wr, 223 op/s 2024-09-21T07:39:13.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 559115 14.37 MB/sec execute 90 sec latency 15.420 ms 2024-09-21T07:39:14.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 561800 14.36 MB/sec execute 91 sec latency 9.149 ms 2024-09-21T07:39:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:13 smithi187 ceph-mon[34367]: pgmap v476: 97 pgs: 97 active+clean; 201 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2024-09-21T07:39:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:13 smithi123 ceph-mon[34166]: pgmap v476: 97 pgs: 97 active+clean; 201 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2024-09-21T07:39:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:13 smithi060 ceph-mon[31244]: pgmap v476: 97 pgs: 97 active+clean; 201 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.8 MiB/s wr, 273 op/s 2024-09-21T07:39:15.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 564758 14.40 MB/sec execute 92 sec latency 65.880 ms 2024-09-21T07:39:16.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 567164 14.33 MB/sec execute 93 sec latency 18.413 ms 2024-09-21T07:39:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:15 smithi187 ceph-mon[34367]: pgmap v477: 97 pgs: 97 active+clean; 213 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.4 MiB/s wr, 307 op/s 2024-09-21T07:39:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:15 smithi123 ceph-mon[34166]: pgmap v477: 97 pgs: 97 active+clean; 213 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.4 MiB/s wr, 307 op/s 2024-09-21T07:39:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:15 smithi060 ceph-mon[31244]: pgmap v477: 97 pgs: 97 active+clean; 213 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.4 MiB/s wr, 307 op/s 2024-09-21T07:39:17.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 569404 14.33 MB/sec execute 94 sec latency 18.806 ms 2024-09-21T07:39:18.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 572311 14.36 MB/sec execute 95 sec latency 35.871 ms 2024-09-21T07:39:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:17 smithi187 ceph-mon[34367]: pgmap v478: 97 pgs: 97 active+clean; 213 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 255 op/s 2024-09-21T07:39:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:17 smithi123 ceph-mon[34166]: pgmap v478: 97 pgs: 97 active+clean; 213 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 255 op/s 2024-09-21T07:39:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:17 smithi060 ceph-mon[31244]: pgmap v478: 97 pgs: 97 active+clean; 213 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 255 op/s 2024-09-21T07:39:19.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 575437 14.39 MB/sec execute 96 sec latency 14.390 ms 2024-09-21T07:39:20.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 577126 14.32 MB/sec execute 97 sec latency 69.459 ms 2024-09-21T07:39:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:19 smithi187 ceph-mon[34367]: pgmap v479: 97 pgs: 97 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 312 op/s 2024-09-21T07:39:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:19 smithi123 ceph-mon[34166]: pgmap v479: 97 pgs: 97 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 312 op/s 2024-09-21T07:39:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:19 smithi060 ceph-mon[31244]: pgmap v479: 97 pgs: 97 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.6 MiB/s wr, 312 op/s 2024-09-21T07:39:21.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 579699 14.32 MB/sec execute 98 sec latency 30.995 ms 2024-09-21T07:39:22.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 582794 14.36 MB/sec execute 99 sec latency 7.468 ms 2024-09-21T07:39:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:21 smithi187 ceph-mon[34367]: pgmap v480: 97 pgs: 97 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 227 op/s 2024-09-21T07:39:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:21 smithi123 ceph-mon[34166]: pgmap v480: 97 pgs: 97 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 227 op/s 2024-09-21T07:39:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:21 smithi060 ceph-mon[31244]: pgmap v480: 97 pgs: 97 active+clean; 217 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 227 op/s 2024-09-21T07:39:23.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 585527 14.34 MB/sec execute 100 sec latency 14.830 ms 2024-09-21T07:39:24.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 587661 14.32 MB/sec execute 101 sec latency 12.147 ms 2024-09-21T07:39:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:23 smithi187 ceph-mon[34367]: pgmap v481: 97 pgs: 97 active+clean; 220 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 310 op/s 2024-09-21T07:39:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:23 smithi123 ceph-mon[34166]: pgmap v481: 97 pgs: 97 active+clean; 220 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 310 op/s 2024-09-21T07:39:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:23 smithi060 ceph-mon[31244]: pgmap v481: 97 pgs: 97 active+clean; 220 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 310 op/s 2024-09-21T07:39:25.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 590016 14.31 MB/sec execute 102 sec latency 43.489 ms 2024-09-21T07:39:26.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 592807 14.30 MB/sec execute 103 sec latency 34.316 ms 2024-09-21T07:39:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:25 smithi187 ceph-mon[34367]: pgmap v482: 97 pgs: 97 active+clean; 220 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 285 op/s 2024-09-21T07:39:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:25 smithi123 ceph-mon[34166]: pgmap v482: 97 pgs: 97 active+clean; 220 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 285 op/s 2024-09-21T07:39:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:25 smithi060 ceph-mon[31244]: pgmap v482: 97 pgs: 97 active+clean; 220 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 285 op/s 2024-09-21T07:39:27.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 595010 14.27 MB/sec execute 104 sec latency 16.102 ms 2024-09-21T07:39:28.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 597503 14.27 MB/sec execute 105 sec latency 16.048 ms 2024-09-21T07:39:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:27 smithi187 ceph-mon[34367]: pgmap v483: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:39:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:27 smithi123 ceph-mon[34166]: pgmap v483: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:39:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:27 smithi060 ceph-mon[31244]: pgmap v483: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:39:29.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 600578 14.31 MB/sec execute 106 sec latency 8.897 ms 2024-09-21T07:39:30.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 602856 14.26 MB/sec execute 107 sec latency 63.742 ms 2024-09-21T07:39:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:29 smithi187 ceph-mon[34367]: pgmap v484: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-09-21T07:39:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:29 smithi123 ceph-mon[34166]: pgmap v484: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-09-21T07:39:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:29 smithi060 ceph-mon[31244]: pgmap v484: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.2 MiB/s wr, 331 op/s 2024-09-21T07:39:31.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 604982 14.25 MB/sec execute 108 sec latency 17.720 ms 2024-09-21T07:39:32.097 INFO:tasks.workunit.client.0.smithi060.stdout: 1 607912 14.27 MB/sec execute 109 sec latency 11.293 ms 2024-09-21T07:39:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:31 smithi187 ceph-mon[34367]: pgmap v485: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-09-21T07:39:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:31 smithi123 ceph-mon[34166]: pgmap v485: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-09-21T07:39:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:31 smithi060 ceph-mon[31244]: pgmap v485: 97 pgs: 97 active+clean; 225 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-09-21T07:39:33.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 610988 14.30 MB/sec execute 110 sec latency 17.595 ms 2024-09-21T07:39:34.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 613475 14.26 MB/sec execute 111 sec latency 11.685 ms 2024-09-21T07:39:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:33 smithi187 ceph-mon[34367]: pgmap v486: 97 pgs: 97 active+clean; 226 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-21T07:39:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:33 smithi123 ceph-mon[34166]: pgmap v486: 97 pgs: 97 active+clean; 226 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-21T07:39:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:33 smithi060 ceph-mon[31244]: pgmap v486: 97 pgs: 97 active+clean; 226 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 293 op/s 2024-09-21T07:39:35.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 615344 14.24 MB/sec execute 112 sec latency 101.182 ms 2024-09-21T07:39:36.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 618245 14.27 MB/sec execute 113 sec latency 22.676 ms 2024-09-21T07:39:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:35 smithi187 ceph-mon[34367]: pgmap v487: 97 pgs: 97 active+clean; 230 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 289 op/s 2024-09-21T07:39:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:35 smithi123 ceph-mon[34166]: pgmap v487: 97 pgs: 97 active+clean; 230 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 289 op/s 2024-09-21T07:39:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:35 smithi060 ceph-mon[31244]: pgmap v487: 97 pgs: 97 active+clean; 230 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 289 op/s 2024-09-21T07:39:37.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 621008 14.26 MB/sec execute 114 sec latency 14.139 ms 2024-09-21T07:39:38.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 623727 14.24 MB/sec execute 115 sec latency 12.013 ms 2024-09-21T07:39:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:37 smithi187 ceph-mon[34367]: pgmap v488: 97 pgs: 97 active+clean; 229 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 292 op/s 2024-09-21T07:39:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:37 smithi123 ceph-mon[34166]: pgmap v488: 97 pgs: 97 active+clean; 229 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 292 op/s 2024-09-21T07:39:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:37 smithi060 ceph-mon[31244]: pgmap v488: 97 pgs: 97 active+clean; 229 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 292 op/s 2024-09-21T07:39:39.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 626010 14.24 MB/sec execute 116 sec latency 18.229 ms 2024-09-21T07:39:40.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 628845 14.27 MB/sec execute 117 sec latency 38.217 ms 2024-09-21T07:39:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:39 smithi187 ceph-mon[34367]: pgmap v489: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 283 op/s 2024-09-21T07:39:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:39 smithi123 ceph-mon[34166]: pgmap v489: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 283 op/s 2024-09-21T07:39:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:39 smithi060 ceph-mon[31244]: pgmap v489: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 283 op/s 2024-09-21T07:39:41.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 631002 14.21 MB/sec execute 118 sec latency 43.433 ms 2024-09-21T07:39:42.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 633140 14.20 MB/sec execute 119 sec latency 11.599 ms 2024-09-21T07:39:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:41 smithi187 ceph-mon[34367]: pgmap v490: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-21T07:39:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:41 smithi123 ceph-mon[34166]: pgmap v490: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-21T07:39:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:41 smithi060 ceph-mon[31244]: pgmap v490: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-21T07:39:43.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 636114 14.24 MB/sec execute 120 sec latency 9.752 ms 2024-09-21T07:39:44.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 639045 14.24 MB/sec execute 121 sec latency 20.812 ms 2024-09-21T07:39:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:43 smithi187 ceph-mon[34367]: pgmap v491: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 274 op/s 2024-09-21T07:39:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:43 smithi123 ceph-mon[34166]: pgmap v491: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 274 op/s 2024-09-21T07:39:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:43 smithi060 ceph-mon[31244]: pgmap v491: 97 pgs: 97 active+clean; 234 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 274 op/s 2024-09-21T07:39:45.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 641591 14.22 MB/sec execute 122 sec latency 12.777 ms 2024-09-21T07:39:46.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 643402 14.20 MB/sec execute 123 sec latency 64.431 ms 2024-09-21T07:39:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:45 smithi187 ceph-mon[34367]: pgmap v492: 97 pgs: 97 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 314 op/s 2024-09-21T07:39:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:45 smithi123 ceph-mon[34166]: pgmap v492: 97 pgs: 97 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 314 op/s 2024-09-21T07:39:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:45 smithi060 ceph-mon[31244]: pgmap v492: 97 pgs: 97 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 314 op/s 2024-09-21T07:39:47.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 646463 14.23 MB/sec execute 124 sec latency 22.665 ms 2024-09-21T07:39:48.098 INFO:tasks.workunit.client.0.smithi060.stdout: 1 648836 14.19 MB/sec execute 125 sec latency 12.879 ms 2024-09-21T07:39:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:47 smithi187 ceph-mon[34367]: pgmap v493: 97 pgs: 97 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 264 op/s 2024-09-21T07:39:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:47 smithi123 ceph-mon[34166]: pgmap v493: 97 pgs: 97 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 264 op/s 2024-09-21T07:39:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:47 smithi060 ceph-mon[31244]: pgmap v493: 97 pgs: 97 active+clean; 238 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 264 op/s 2024-09-21T07:39:49.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 651073 14.18 MB/sec execute 126 sec latency 12.036 ms 2024-09-21T07:39:50.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 653872 14.21 MB/sec execute 127 sec latency 10.400 ms 2024-09-21T07:39:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:49 smithi187 ceph-mon[34367]: pgmap v494: 97 pgs: 97 active+clean; 242 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 324 op/s 2024-09-21T07:39:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:49 smithi123 ceph-mon[34166]: pgmap v494: 97 pgs: 97 active+clean; 242 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 324 op/s 2024-09-21T07:39:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:49 smithi060 ceph-mon[31244]: pgmap v494: 97 pgs: 97 active+clean; 242 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 324 op/s 2024-09-21T07:39:51.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 656436 14.19 MB/sec execute 128 sec latency 84.590 ms 2024-09-21T07:39:52.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 658623 14.17 MB/sec execute 129 sec latency 16.492 ms 2024-09-21T07:39:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:51 smithi187 ceph-mon[34367]: pgmap v495: 97 pgs: 97 active+clean; 242 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 239 op/s 2024-09-21T07:39:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:51 smithi123 ceph-mon[34166]: pgmap v495: 97 pgs: 97 active+clean; 242 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 239 op/s 2024-09-21T07:39:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:51 smithi060 ceph-mon[31244]: pgmap v495: 97 pgs: 97 active+clean; 242 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 239 op/s 2024-09-21T07:39:53.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 661240 14.17 MB/sec execute 130 sec latency 12.133 ms 2024-09-21T07:39:54.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 664361 14.21 MB/sec execute 131 sec latency 12.288 ms 2024-09-21T07:39:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:53 smithi187 ceph-mon[34367]: pgmap v496: 97 pgs: 97 active+clean; 246 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-09-21T07:39:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:53 smithi123 ceph-mon[34166]: pgmap v496: 97 pgs: 97 active+clean; 246 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-09-21T07:39:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:53 smithi060 ceph-mon[31244]: pgmap v496: 97 pgs: 97 active+clean; 246 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 272 op/s 2024-09-21T07:39:55.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 667003 14.20 MB/sec execute 132 sec latency 19.149 ms 2024-09-21T07:39:56.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 668730 14.16 MB/sec execute 133 sec latency 70.277 ms 2024-09-21T07:39:56.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:55 smithi187 ceph-mon[34367]: pgmap v497: 97 pgs: 97 active+clean; 248 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 277 op/s 2024-09-21T07:39:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:55 smithi123 ceph-mon[34166]: pgmap v497: 97 pgs: 97 active+clean; 248 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 277 op/s 2024-09-21T07:39:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:55 smithi060 ceph-mon[31244]: pgmap v497: 97 pgs: 97 active+clean; 248 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 277 op/s 2024-09-21T07:39:57.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 671534 14.18 MB/sec execute 134 sec latency 18.447 ms 2024-09-21T07:39:58.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 674232 14.17 MB/sec execute 135 sec latency 15.754 ms 2024-09-21T07:39:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:57 smithi187 ceph-mon[34367]: pgmap v498: 97 pgs: 97 active+clean; 251 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 280 op/s 2024-09-21T07:39:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:57 smithi123 ceph-mon[34166]: pgmap v498: 97 pgs: 97 active+clean; 251 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 280 op/s 2024-09-21T07:39:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:57 smithi060 ceph-mon[31244]: pgmap v498: 97 pgs: 97 active+clean; 251 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 280 op/s 2024-09-21T07:39:59.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 676406 14.15 MB/sec execute 136 sec latency 15.056 ms 2024-09-21T07:40:00.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 678970 14.15 MB/sec execute 137 sec latency 13.291 ms 2024-09-21T07:40:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:39:59 smithi187 ceph-mon[34367]: pgmap v499: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:40:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:39:59 smithi123 ceph-mon[34166]: pgmap v499: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:40:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:39:59 smithi060 ceph-mon[31244]: pgmap v499: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 309 op/s 2024-09-21T07:40:01.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 681818 14.17 MB/sec execute 138 sec latency 76.814 ms 2024-09-21T07:40:01.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:00 smithi187 ceph-mon[34367]: overall HEALTH_OK 2024-09-21T07:40:01.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:00 smithi123 ceph-mon[34166]: overall HEALTH_OK 2024-09-21T07:40:01.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:00 smithi060 ceph-mon[31244]: overall HEALTH_OK 2024-09-21T07:40:02.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 684106 14.12 MB/sec execute 139 sec latency 18.314 ms 2024-09-21T07:40:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:01 smithi187 ceph-mon[34367]: pgmap v500: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:40:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:01 smithi123 ceph-mon[34166]: pgmap v500: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:40:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:01 smithi060 ceph-mon[31244]: pgmap v500: 97 pgs: 97 active+clean; 253 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:40:03.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 686314 14.12 MB/sec execute 140 sec latency 12.278 ms 2024-09-21T07:40:04.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 689330 14.15 MB/sec execute 141 sec latency 10.948 ms 2024-09-21T07:40:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:03 smithi187 ceph-mon[34367]: pgmap v501: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-09-21T07:40:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:03 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:03 smithi123 ceph-mon[34166]: pgmap v501: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-09-21T07:40:04.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:03 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:03 smithi060 ceph-mon[31244]: pgmap v501: 97 pgs: 97 active+clean; 254 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-09-21T07:40:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:03 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:40:05.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 692297 14.15 MB/sec execute 142 sec latency 12.829 ms 2024-09-21T07:40:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:40:05.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:05.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:05.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:40:05.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:40:05.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:40:05.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:40:06.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 694110 14.12 MB/sec execute 143 sec latency 51.606 ms 2024-09-21T07:40:06.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:06 smithi187 ceph-mon[34367]: pgmap v502: 97 pgs: 97 active+clean; 256 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-09-21T07:40:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:06 smithi123 ceph-mon[34166]: pgmap v502: 97 pgs: 97 active+clean; 256 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-09-21T07:40:06.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:06 smithi060 ceph-mon[31244]: pgmap v502: 97 pgs: 97 active+clean; 256 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-09-21T07:40:07.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 696607 14.12 MB/sec execute 144 sec latency 17.531 ms 2024-09-21T07:40:08.099 INFO:tasks.workunit.client.0.smithi060.stdout: 1 699677 14.15 MB/sec execute 145 sec latency 26.813 ms 2024-09-21T07:40:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:08 smithi187 ceph-mon[34367]: pgmap v503: 97 pgs: 97 active+clean; 256 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-21T07:40:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:08 smithi123 ceph-mon[34166]: pgmap v503: 97 pgs: 97 active+clean; 256 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-21T07:40:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:08 smithi060 ceph-mon[31244]: pgmap v503: 97 pgs: 97 active+clean; 256 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 276 op/s 2024-09-21T07:40:09.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 702081 14.11 MB/sec execute 146 sec latency 19.436 ms 2024-09-21T07:40:10.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 704315 14.11 MB/sec execute 147 sec latency 12.224 ms 2024-09-21T07:40:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:10 smithi187 ceph-mon[34367]: pgmap v504: 97 pgs: 97 active+clean; 260 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:40:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:10 smithi123 ceph-mon[34166]: pgmap v504: 97 pgs: 97 active+clean; 260 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:40:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:10 smithi060 ceph-mon[31244]: pgmap v504: 97 pgs: 97 active+clean; 260 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:40:11.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 707016 14.13 MB/sec execute 148 sec latency 42.676 ms 2024-09-21T07:40:12.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 709666 14.12 MB/sec execute 149 sec latency 25.331 ms 2024-09-21T07:40:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:12 smithi187 ceph-mon[34367]: pgmap v505: 97 pgs: 97 active+clean; 260 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 234 op/s 2024-09-21T07:40:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:12 smithi123 ceph-mon[34166]: pgmap v505: 97 pgs: 97 active+clean; 260 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 234 op/s 2024-09-21T07:40:12.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:12 smithi060 ceph-mon[31244]: pgmap v505: 97 pgs: 97 active+clean; 260 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 234 op/s 2024-09-21T07:40:13.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 711864 14.10 MB/sec execute 150 sec latency 20.248 ms 2024-09-21T07:40:14.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 714357 14.10 MB/sec execute 151 sec latency 8.876 ms 2024-09-21T07:40:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:14 smithi187 ceph-mon[34367]: pgmap v506: 97 pgs: 97 active+clean; 261 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 282 op/s 2024-09-21T07:40:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:14 smithi123 ceph-mon[34166]: pgmap v506: 97 pgs: 97 active+clean; 261 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 282 op/s 2024-09-21T07:40:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:14 smithi060 ceph-mon[31244]: pgmap v506: 97 pgs: 97 active+clean; 261 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 282 op/s 2024-09-21T07:40:15.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 717418 14.13 MB/sec execute 152 sec latency 16.451 ms 2024-09-21T07:40:16.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 719207 14.08 MB/sec execute 153 sec latency 61.232 ms 2024-09-21T07:40:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:16 smithi187 ceph-mon[34367]: pgmap v507: 97 pgs: 97 active+clean; 263 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 270 op/s 2024-09-21T07:40:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:16 smithi123 ceph-mon[34166]: pgmap v507: 97 pgs: 97 active+clean; 263 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 270 op/s 2024-09-21T07:40:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:16 smithi060 ceph-mon[31244]: pgmap v507: 97 pgs: 97 active+clean; 263 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 270 op/s 2024-09-21T07:40:17.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 721476 14.07 MB/sec execute 154 sec latency 24.809 ms 2024-09-21T07:40:18.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 724509 14.10 MB/sec execute 155 sec latency 13.217 ms 2024-09-21T07:40:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:18 smithi187 ceph-mon[34367]: pgmap v508: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2024-09-21T07:40:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:18 smithi123 ceph-mon[34166]: pgmap v508: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2024-09-21T07:40:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:18 smithi060 ceph-mon[31244]: pgmap v508: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2024-09-21T07:40:19.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 726782 14.06 MB/sec execute 156 sec latency 13.624 ms 2024-09-21T07:40:20.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 728691 14.05 MB/sec execute 157 sec latency 12.542 ms 2024-09-21T07:40:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:20 smithi187 ceph-mon[34367]: pgmap v509: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:40:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:20 smithi123 ceph-mon[34166]: pgmap v509: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:40:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:20 smithi060 ceph-mon[31244]: pgmap v509: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-09-21T07:40:21.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 731563 14.07 MB/sec execute 158 sec latency 89.675 ms 2024-09-21T07:40:22.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 733937 14.04 MB/sec execute 159 sec latency 14.418 ms 2024-09-21T07:40:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:22 smithi187 ceph-mon[34367]: pgmap v510: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 203 op/s 2024-09-21T07:40:22.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:22 smithi123 ceph-mon[34166]: pgmap v510: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 203 op/s 2024-09-21T07:40:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:22 smithi060 ceph-mon[31244]: pgmap v510: 97 pgs: 97 active+clean; 268 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 203 op/s 2024-09-21T07:40:23.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 736201 14.04 MB/sec execute 160 sec latency 12.015 ms 2024-09-21T07:40:24.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 739035 14.06 MB/sec execute 161 sec latency 15.879 ms 2024-09-21T07:40:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:24 smithi187 ceph-mon[34367]: pgmap v511: 97 pgs: 97 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 310 op/s 2024-09-21T07:40:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:24 smithi123 ceph-mon[34166]: pgmap v511: 97 pgs: 97 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 310 op/s 2024-09-21T07:40:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:24 smithi060 ceph-mon[31244]: pgmap v511: 97 pgs: 97 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.2 MiB/s wr, 310 op/s 2024-09-21T07:40:25.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 742191 14.08 MB/sec execute 162 sec latency 11.274 ms 2024-09-21T07:40:26.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 744423 14.04 MB/sec execute 163 sec latency 33.040 ms 2024-09-21T07:40:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:26 smithi187 ceph-mon[34367]: pgmap v512: 97 pgs: 97 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:40:26.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:26 smithi123 ceph-mon[34166]: pgmap v512: 97 pgs: 97 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:40:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:26 smithi060 ceph-mon[31244]: pgmap v512: 97 pgs: 97 active+clean; 271 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:40:27.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 746343 14.03 MB/sec execute 164 sec latency 66.423 ms 2024-09-21T07:40:28.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 749316 14.05 MB/sec execute 165 sec latency 104.337 ms 2024-09-21T07:40:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:28 smithi187 ceph-mon[34367]: pgmap v513: 97 pgs: 97 active+clean; 270 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2024-09-21T07:40:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:28 smithi123 ceph-mon[34166]: pgmap v513: 97 pgs: 97 active+clean; 270 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2024-09-21T07:40:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:28 smithi060 ceph-mon[31244]: pgmap v513: 97 pgs: 97 active+clean; 270 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2024-09-21T07:40:29.100 INFO:tasks.workunit.client.0.smithi060.stdout: 1 751789 14.03 MB/sec execute 166 sec latency 14.666 ms 2024-09-21T07:40:30.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 754178 14.04 MB/sec execute 167 sec latency 11.711 ms 2024-09-21T07:40:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:30 smithi187 ceph-mon[34367]: pgmap v514: 97 pgs: 97 active+clean; 274 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 279 op/s 2024-09-21T07:40:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:30 smithi123 ceph-mon[34166]: pgmap v514: 97 pgs: 97 active+clean; 274 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 279 op/s 2024-09-21T07:40:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:30 smithi060 ceph-mon[31244]: pgmap v514: 97 pgs: 97 active+clean; 274 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 279 op/s 2024-09-21T07:40:31.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 756879 14.04 MB/sec execute 168 sec latency 12.787 ms 2024-09-21T07:40:32.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 759298 14.03 MB/sec execute 169 sec latency 76.945 ms 2024-09-21T07:40:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:32 smithi123 ceph-mon[34166]: pgmap v515: 97 pgs: 97 active+clean; 274 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 252 op/s 2024-09-21T07:40:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:32 smithi060 ceph-mon[31244]: pgmap v515: 97 pgs: 97 active+clean; 274 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 252 op/s 2024-09-21T07:40:32.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:32 smithi187 ceph-mon[34367]: pgmap v515: 97 pgs: 97 active+clean; 274 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 252 op/s 2024-09-21T07:40:33.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 761128 14.00 MB/sec execute 170 sec latency 135.308 ms 2024-09-21T07:40:34.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 763880 14.02 MB/sec execute 171 sec latency 15.652 ms 2024-09-21T07:40:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:34 smithi123 ceph-mon[34166]: pgmap v516: 97 pgs: 97 active+clean; 275 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:40:34.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:34 smithi060 ceph-mon[31244]: pgmap v516: 97 pgs: 97 active+clean; 275 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:40:34.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:34 smithi187 ceph-mon[34367]: pgmap v516: 97 pgs: 97 active+clean; 275 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:40:35.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 766945 14.04 MB/sec execute 172 sec latency 12.124 ms 2024-09-21T07:40:36.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 768951 14.00 MB/sec execute 173 sec latency 17.377 ms 2024-09-21T07:40:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:36 smithi123 ceph-mon[34166]: pgmap v517: 97 pgs: 97 active+clean; 279 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-09-21T07:40:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:36 smithi060 ceph-mon[31244]: pgmap v517: 97 pgs: 97 active+clean; 279 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-09-21T07:40:36.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:36 smithi187 ceph-mon[34367]: pgmap v517: 97 pgs: 97 active+clean; 279 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-09-21T07:40:37.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 770981 14.00 MB/sec execute 174 sec latency 89.881 ms 2024-09-21T07:40:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:37 smithi187 ceph-mon[34367]: pgmap v518: 97 pgs: 97 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 270 op/s 2024-09-21T07:40:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:37 smithi123 ceph-mon[34166]: pgmap v518: 97 pgs: 97 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 270 op/s 2024-09-21T07:40:38.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 773794 14.00 MB/sec execute 175 sec latency 14.936 ms 2024-09-21T07:40:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:37 smithi060 ceph-mon[31244]: pgmap v518: 97 pgs: 97 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 270 op/s 2024-09-21T07:40:39.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 775740 13.97 MB/sec execute 176 sec latency 11.724 ms 2024-09-21T07:40:40.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:39 smithi123 ceph-mon[34166]: pgmap v519: 97 pgs: 97 active+clean; 288 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.1 MiB/s wr, 319 op/s 2024-09-21T07:40:40.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 778256 13.97 MB/sec execute 177 sec latency 12.709 ms 2024-09-21T07:40:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:39 smithi060 ceph-mon[31244]: pgmap v519: 97 pgs: 97 active+clean; 288 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.1 MiB/s wr, 319 op/s 2024-09-21T07:40:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:39 smithi187 ceph-mon[34367]: pgmap v519: 97 pgs: 97 active+clean; 288 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.1 MiB/s wr, 319 op/s 2024-09-21T07:40:41.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 781274 14.00 MB/sec execute 178 sec latency 11.976 ms 2024-09-21T07:40:42.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:41 smithi123 ceph-mon[34166]: pgmap v520: 97 pgs: 97 active+clean; 288 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T07:40:42.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 783493 13.96 MB/sec execute 179 sec latency 62.654 ms 2024-09-21T07:40:42.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:41 smithi060 ceph-mon[31244]: pgmap v520: 97 pgs: 97 active+clean; 288 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T07:40:42.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:41 smithi187 ceph-mon[34367]: pgmap v520: 97 pgs: 97 active+clean; 288 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T07:40:43.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 785605 13.96 MB/sec execute 180 sec latency 13.922 ms 2024-09-21T07:40:44.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:43 smithi123 ceph-mon[34166]: pgmap v521: 97 pgs: 97 active+clean; 291 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 282 op/s 2024-09-21T07:40:44.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 788597 13.98 MB/sec execute 181 sec latency 17.381 ms 2024-09-21T07:40:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:43 smithi060 ceph-mon[31244]: pgmap v521: 97 pgs: 97 active+clean; 291 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 282 op/s 2024-09-21T07:40:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:43 smithi187 ceph-mon[34367]: pgmap v521: 97 pgs: 97 active+clean; 291 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 282 op/s 2024-09-21T07:40:45.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 791590 13.99 MB/sec execute 182 sec latency 11.696 ms 2024-09-21T07:40:46.101 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:45 smithi123 ceph-mon[34166]: pgmap v522: 97 pgs: 97 active+clean; 292 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 290 op/s 2024-09-21T07:40:46.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 793955 13.97 MB/sec execute 183 sec latency 13.954 ms 2024-09-21T07:40:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:45 smithi060 ceph-mon[31244]: pgmap v522: 97 pgs: 97 active+clean; 292 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 290 op/s 2024-09-21T07:40:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:45 smithi187 ceph-mon[34367]: pgmap v522: 97 pgs: 97 active+clean; 292 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 290 op/s 2024-09-21T07:40:47.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 795940 13.96 MB/sec execute 184 sec latency 72.182 ms 2024-09-21T07:40:48.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:47 smithi123 ceph-mon[34166]: pgmap v523: 97 pgs: 97 active+clean; 290 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 239 op/s 2024-09-21T07:40:48.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 798960 13.98 MB/sec execute 185 sec latency 24.543 ms 2024-09-21T07:40:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:47 smithi060 ceph-mon[31244]: pgmap v523: 97 pgs: 97 active+clean; 290 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 239 op/s 2024-09-21T07:40:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:47 smithi187 ceph-mon[34367]: pgmap v523: 97 pgs: 97 active+clean; 290 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.4 MiB/s wr, 239 op/s 2024-09-21T07:40:49.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 801316 13.95 MB/sec execute 186 sec latency 17.994 ms 2024-09-21T07:40:50.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:49 smithi123 ceph-mon[34166]: pgmap v524: 97 pgs: 97 active+clean; 296 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 311 op/s 2024-09-21T07:40:50.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 803479 13.95 MB/sec execute 187 sec latency 11.374 ms 2024-09-21T07:40:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:49 smithi060 ceph-mon[31244]: pgmap v524: 97 pgs: 97 active+clean; 296 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 311 op/s 2024-09-21T07:40:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:49 smithi187 ceph-mon[34367]: pgmap v524: 97 pgs: 97 active+clean; 296 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.0 MiB/s wr, 311 op/s 2024-09-21T07:40:51.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 806396 13.97 MB/sec execute 188 sec latency 11.781 ms 2024-09-21T07:40:52.071 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:51 smithi187 ceph-mon[34367]: pgmap v525: 97 pgs: 97 active+clean; 296 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 231 op/s 2024-09-21T07:40:52.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:51 smithi123 ceph-mon[34166]: pgmap v525: 97 pgs: 97 active+clean; 296 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 231 op/s 2024-09-21T07:40:52.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 809141 13.97 MB/sec execute 189 sec latency 44.010 ms 2024-09-21T07:40:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:51 smithi060 ceph-mon[31244]: pgmap v525: 97 pgs: 97 active+clean; 296 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.1 MiB/s wr, 231 op/s 2024-09-21T07:40:53.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 810990 13.95 MB/sec execute 190 sec latency 22.815 ms 2024-09-21T07:40:54.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:53 smithi123 ceph-mon[34166]: pgmap v526: 97 pgs: 97 active+clean; 293 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:40:54.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 813602 13.95 MB/sec execute 191 sec latency 23.315 ms 2024-09-21T07:40:54.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:53 smithi060 ceph-mon[31244]: pgmap v526: 97 pgs: 97 active+clean; 293 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:40:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:53 smithi187 ceph-mon[34367]: pgmap v526: 97 pgs: 97 active+clean; 293 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:40:55.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 816597 13.97 MB/sec execute 192 sec latency 35.203 ms 2024-09-21T07:40:56.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:55 smithi123 ceph-mon[34166]: pgmap v527: 97 pgs: 97 active+clean; 297 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 278 op/s 2024-09-21T07:40:56.101 INFO:tasks.workunit.client.0.smithi060.stdout: 1 819061 13.95 MB/sec execute 193 sec latency 26.027 ms 2024-09-21T07:40:56.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:55 smithi060 ceph-mon[31244]: pgmap v527: 97 pgs: 97 active+clean; 297 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 278 op/s 2024-09-21T07:40:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:55 smithi187 ceph-mon[34367]: pgmap v527: 97 pgs: 97 active+clean; 297 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 278 op/s 2024-09-21T07:40:57.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 821049 13.94 MB/sec execute 194 sec latency 39.170 ms 2024-09-21T07:40:58.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:57 smithi123 ceph-mon[34166]: pgmap v528: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 263 op/s 2024-09-21T07:40:58.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 823976 13.96 MB/sec execute 195 sec latency 21.948 ms 2024-09-21T07:40:58.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:57 smithi060 ceph-mon[31244]: pgmap v528: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 263 op/s 2024-09-21T07:40:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:57 smithi187 ceph-mon[34367]: pgmap v528: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 263 op/s 2024-09-21T07:40:59.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 826674 13.95 MB/sec execute 196 sec latency 18.700 ms 2024-09-21T07:41:00.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:40:59 smithi123 ceph-mon[34166]: pgmap v529: 97 pgs: 97 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 327 op/s 2024-09-21T07:41:00.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 829003 13.94 MB/sec execute 197 sec latency 11.497 ms 2024-09-21T07:41:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:40:59 smithi060 ceph-mon[31244]: pgmap v529: 97 pgs: 97 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 327 op/s 2024-09-21T07:41:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:40:59 smithi187 ceph-mon[34367]: pgmap v529: 97 pgs: 97 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 327 op/s 2024-09-21T07:41:01.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 831565 13.94 MB/sec execute 198 sec latency 19.578 ms 2024-09-21T07:41:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:01 smithi123 ceph-mon[34166]: pgmap v530: 97 pgs: 97 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 229 op/s 2024-09-21T07:41:02.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 834427 13.96 MB/sec execute 199 sec latency 87.527 ms 2024-09-21T07:41:02.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:01 smithi060 ceph-mon[31244]: pgmap v530: 97 pgs: 97 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 229 op/s 2024-09-21T07:41:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:01 smithi187 ceph-mon[34367]: pgmap v530: 97 pgs: 97 active+clean; 279 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 229 op/s 2024-09-21T07:41:03.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 836787 13.93 MB/sec execute 200 sec latency 25.883 ms 2024-09-21T07:41:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:03 smithi123 ceph-mon[34166]: pgmap v531: 97 pgs: 97 active+clean; 278 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 266 op/s 2024-09-21T07:41:04.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 839015 13.93 MB/sec execute 201 sec latency 16.510 ms 2024-09-21T07:41:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:03 smithi060 ceph-mon[31244]: pgmap v531: 97 pgs: 97 active+clean; 278 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 266 op/s 2024-09-21T07:41:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:03 smithi187 ceph-mon[34367]: pgmap v531: 97 pgs: 97 active+clean; 278 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 266 op/s 2024-09-21T07:41:05.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:05.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:41:05.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 841777 13.95 MB/sec execute 202 sec latency 11.118 ms 2024-09-21T07:41:05.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:05.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:05.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:05.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:41:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:41:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:41:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:41:05.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:41:06.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:05 smithi123 ceph-mon[34166]: pgmap v532: 97 pgs: 97 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 308 op/s 2024-09-21T07:41:06.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 844477 13.94 MB/sec execute 203 sec latency 16.264 ms 2024-09-21T07:41:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:05 smithi060 ceph-mon[31244]: pgmap v532: 97 pgs: 97 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 308 op/s 2024-09-21T07:41:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:05 smithi187 ceph-mon[34367]: pgmap v532: 97 pgs: 97 active+clean; 281 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 308 op/s 2024-09-21T07:41:07.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 846430 13.93 MB/sec execute 204 sec latency 65.384 ms 2024-09-21T07:41:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:07 smithi123 ceph-mon[34166]: pgmap v533: 97 pgs: 97 active+clean; 282 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 262 op/s 2024-09-21T07:41:08.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 848982 13.93 MB/sec execute 205 sec latency 90.305 ms 2024-09-21T07:41:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:07 smithi060 ceph-mon[31244]: pgmap v533: 97 pgs: 97 active+clean; 282 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 262 op/s 2024-09-21T07:41:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:07 smithi187 ceph-mon[34367]: pgmap v533: 97 pgs: 97 active+clean; 282 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 262 op/s 2024-09-21T07:41:09.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 851757 13.93 MB/sec execute 206 sec latency 34.013 ms 2024-09-21T07:41:10.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:09 smithi123 ceph-mon[34166]: pgmap v534: 97 pgs: 97 active+clean; 286 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 324 op/s 2024-09-21T07:41:10.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 853720 13.91 MB/sec execute 207 sec latency 38.585 ms 2024-09-21T07:41:10.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:09 smithi060 ceph-mon[31244]: pgmap v534: 97 pgs: 97 active+clean; 286 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 324 op/s 2024-09-21T07:41:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:09 smithi187 ceph-mon[34367]: pgmap v534: 97 pgs: 97 active+clean; 286 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 324 op/s 2024-09-21T07:41:11.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 856352 13.92 MB/sec execute 208 sec latency 16.258 ms 2024-09-21T07:41:12.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:11 smithi123 ceph-mon[34166]: pgmap v535: 97 pgs: 97 active+clean; 286 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 232 op/s 2024-09-21T07:41:12.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 859418 13.94 MB/sec execute 209 sec latency 14.658 ms 2024-09-21T07:41:12.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:11 smithi060 ceph-mon[31244]: pgmap v535: 97 pgs: 97 active+clean; 286 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 232 op/s 2024-09-21T07:41:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:11 smithi187 ceph-mon[34367]: pgmap v535: 97 pgs: 97 active+clean; 286 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 232 op/s 2024-09-21T07:41:13.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 861463 13.90 MB/sec execute 210 sec latency 53.271 ms 2024-09-21T07:41:14.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:13 smithi123 ceph-mon[34166]: pgmap v536: 97 pgs: 97 active+clean; 285 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 266 op/s 2024-09-21T07:41:14.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 863571 13.90 MB/sec execute 211 sec latency 11.791 ms 2024-09-21T07:41:14.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:13 smithi060 ceph-mon[31244]: pgmap v536: 97 pgs: 97 active+clean; 285 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 266 op/s 2024-09-21T07:41:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:13 smithi187 ceph-mon[34367]: pgmap v536: 97 pgs: 97 active+clean; 285 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 266 op/s 2024-09-21T07:41:15.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 866584 13.92 MB/sec execute 212 sec latency 9.904 ms 2024-09-21T07:41:16.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:15 smithi123 ceph-mon[34166]: pgmap v537: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 297 op/s 2024-09-21T07:41:16.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 869290 13.92 MB/sec execute 213 sec latency 13.833 ms 2024-09-21T07:41:16.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:15 smithi060 ceph-mon[31244]: pgmap v537: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 297 op/s 2024-09-21T07:41:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:15 smithi187 ceph-mon[34367]: pgmap v537: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 297 op/s 2024-09-21T07:41:17.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 871503 13.91 MB/sec execute 214 sec latency 13.863 ms 2024-09-21T07:41:18.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:17 smithi123 ceph-mon[34166]: pgmap v538: 97 pgs: 97 active+clean; 290 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 271 op/s 2024-09-21T07:41:18.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 873846 13.91 MB/sec execute 215 sec latency 59.464 ms 2024-09-21T07:41:18.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:17 smithi060 ceph-mon[31244]: pgmap v538: 97 pgs: 97 active+clean; 290 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 271 op/s 2024-09-21T07:41:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:17 smithi187 ceph-mon[34367]: pgmap v538: 97 pgs: 97 active+clean; 290 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 271 op/s 2024-09-21T07:41:19.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 876940 13.92 MB/sec execute 216 sec latency 12.625 ms 2024-09-21T07:41:20.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:19 smithi123 ceph-mon[34166]: pgmap v539: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 285 op/s 2024-09-21T07:41:20.102 INFO:tasks.workunit.client.0.smithi060.stdout: 1 879227 13.90 MB/sec execute 217 sec latency 87.509 ms 2024-09-21T07:41:20.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:19 smithi060 ceph-mon[31244]: pgmap v539: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 285 op/s 2024-09-21T07:41:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:19 smithi187 ceph-mon[34367]: pgmap v539: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.7 MiB/s wr, 285 op/s 2024-09-21T07:41:21.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 881399 13.89 MB/sec execute 218 sec latency 11.925 ms 2024-09-21T07:41:22.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:21 smithi123 ceph-mon[34166]: pgmap v540: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 194 op/s 2024-09-21T07:41:22.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 884409 13.91 MB/sec execute 219 sec latency 9.446 ms 2024-09-21T07:41:22.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:21 smithi060 ceph-mon[31244]: pgmap v540: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 194 op/s 2024-09-21T07:41:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:21 smithi187 ceph-mon[34367]: pgmap v540: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 194 op/s 2024-09-21T07:41:23.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 886614 13.89 MB/sec execute 220 sec latency 68.972 ms 2024-09-21T07:41:24.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:23 smithi123 ceph-mon[34166]: pgmap v541: 97 pgs: 97 active+clean; 295 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:41:24.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 888830 13.88 MB/sec execute 221 sec latency 11.907 ms 2024-09-21T07:41:24.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:23 smithi060 ceph-mon[31244]: pgmap v541: 97 pgs: 97 active+clean; 295 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:41:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:23 smithi187 ceph-mon[34367]: pgmap v541: 97 pgs: 97 active+clean; 295 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:41:25.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 891591 13.90 MB/sec execute 222 sec latency 10.506 ms 2024-09-21T07:41:26.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:25 smithi123 ceph-mon[34166]: pgmap v542: 97 pgs: 97 active+clean; 294 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 278 op/s 2024-09-21T07:41:26.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 894732 13.91 MB/sec execute 223 sec latency 12.275 ms 2024-09-21T07:41:26.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:25 smithi060 ceph-mon[31244]: pgmap v542: 97 pgs: 97 active+clean; 294 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 278 op/s 2024-09-21T07:41:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:25 smithi187 ceph-mon[34367]: pgmap v542: 97 pgs: 97 active+clean; 294 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 278 op/s 2024-09-21T07:41:27.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 896837 13.89 MB/sec execute 224 sec latency 71.162 ms 2024-09-21T07:41:28.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:27 smithi123 ceph-mon[34166]: pgmap v543: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-21T07:41:28.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 898819 13.88 MB/sec execute 225 sec latency 100.411 ms 2024-09-21T07:41:28.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:27 smithi060 ceph-mon[31244]: pgmap v543: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-21T07:41:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:27 smithi187 ceph-mon[34367]: pgmap v543: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-21T07:41:29.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 901862 13.90 MB/sec execute 226 sec latency 21.003 ms 2024-09-21T07:41:30.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:29 smithi123 ceph-mon[34166]: pgmap v544: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 294 op/s 2024-09-21T07:41:30.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 904239 13.88 MB/sec execute 227 sec latency 14.823 ms 2024-09-21T07:41:30.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:29 smithi060 ceph-mon[31244]: pgmap v544: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 294 op/s 2024-09-21T07:41:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:29 smithi187 ceph-mon[34367]: pgmap v544: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.8 MiB/s wr, 294 op/s 2024-09-21T07:41:31.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 906522 13.88 MB/sec execute 228 sec latency 20.074 ms 2024-09-21T07:41:32.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 909441 13.89 MB/sec execute 229 sec latency 8.820 ms 2024-09-21T07:41:32.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:31 smithi060 ceph-mon[31244]: pgmap v545: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-09-21T07:41:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:31 smithi187 ceph-mon[34367]: pgmap v545: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-09-21T07:41:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:31 smithi123 ceph-mon[34166]: pgmap v545: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-09-21T07:41:33.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 912358 13.91 MB/sec execute 230 sec latency 65.584 ms 2024-09-21T07:41:34.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 914298 13.88 MB/sec execute 231 sec latency 24.615 ms 2024-09-21T07:41:34.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:33 smithi060 ceph-mon[31244]: pgmap v546: 97 pgs: 97 active+clean; 282 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.7 MiB/s wr, 294 op/s 2024-09-21T07:41:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:33 smithi187 ceph-mon[34367]: pgmap v546: 97 pgs: 97 active+clean; 282 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.7 MiB/s wr, 294 op/s 2024-09-21T07:41:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:33 smithi123 ceph-mon[34166]: pgmap v546: 97 pgs: 97 active+clean; 282 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.7 MiB/s wr, 294 op/s 2024-09-21T07:41:35.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 916652 13.88 MB/sec execute 232 sec latency 55.578 ms 2024-09-21T07:41:36.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 919294 13.94 MB/sec execute 233 sec latency 41.854 ms 2024-09-21T07:41:36.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:35 smithi060 ceph-mon[31244]: pgmap v547: 97 pgs: 97 active+clean; 287 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 276 op/s 2024-09-21T07:41:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:35 smithi187 ceph-mon[34367]: pgmap v547: 97 pgs: 97 active+clean; 287 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 276 op/s 2024-09-21T07:41:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:35 smithi123 ceph-mon[34166]: pgmap v547: 97 pgs: 97 active+clean; 287 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 276 op/s 2024-09-21T07:41:37.103 INFO:tasks.workunit.client.0.smithi060.stdout: 1 921770 13.95 MB/sec execute 234 sec latency 17.121 ms 2024-09-21T07:41:38.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 924369 13.95 MB/sec execute 235 sec latency 61.629 ms 2024-09-21T07:41:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:37 smithi060 ceph-mon[31244]: pgmap v548: 97 pgs: 97 active+clean; 286 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-09-21T07:41:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:37 smithi187 ceph-mon[34367]: pgmap v548: 97 pgs: 97 active+clean; 286 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-09-21T07:41:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:37 smithi123 ceph-mon[34166]: pgmap v548: 97 pgs: 97 active+clean; 286 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 283 op/s 2024-09-21T07:41:39.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 927452 13.97 MB/sec execute 236 sec latency 26.065 ms 2024-09-21T07:41:40.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 929831 13.95 MB/sec execute 237 sec latency 23.516 ms 2024-09-21T07:41:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:39 smithi060 ceph-mon[31244]: pgmap v549: 97 pgs: 97 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 308 op/s 2024-09-21T07:41:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:39 smithi187 ceph-mon[34367]: pgmap v549: 97 pgs: 97 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 308 op/s 2024-09-21T07:41:40.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:39 smithi123 ceph-mon[34166]: pgmap v549: 97 pgs: 97 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 308 op/s 2024-09-21T07:41:41.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 932148 13.95 MB/sec execute 238 sec latency 11.627 ms 2024-09-21T07:41:42.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 934987 13.96 MB/sec execute 239 sec latency 17.144 ms 2024-09-21T07:41:42.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:41 smithi060 ceph-mon[31244]: pgmap v550: 97 pgs: 97 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T07:41:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:41 smithi187 ceph-mon[34367]: pgmap v550: 97 pgs: 97 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T07:41:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:41 smithi123 ceph-mon[34166]: pgmap v550: 97 pgs: 97 active+clean; 279 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T07:41:43.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 937785 13.96 MB/sec execute 240 sec latency 48.963 ms 2024-09-21T07:41:44.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 939704 13.94 MB/sec execute 241 sec latency 21.502 ms 2024-09-21T07:41:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:43 smithi060 ceph-mon[31244]: pgmap v551: 97 pgs: 97 active+clean; 278 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 324 op/s 2024-09-21T07:41:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:43 smithi187 ceph-mon[34367]: pgmap v551: 97 pgs: 97 active+clean; 278 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 324 op/s 2024-09-21T07:41:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:43 smithi123 ceph-mon[34166]: pgmap v551: 97 pgs: 97 active+clean; 278 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 324 op/s 2024-09-21T07:41:45.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 942389 13.95 MB/sec execute 242 sec latency 11.585 ms 2024-09-21T07:41:46.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 945430 13.96 MB/sec execute 243 sec latency 8.233 ms 2024-09-21T07:41:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:45 smithi060 ceph-mon[31244]: pgmap v552: 97 pgs: 97 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 299 op/s 2024-09-21T07:41:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:45 smithi187 ceph-mon[34367]: pgmap v552: 97 pgs: 97 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 299 op/s 2024-09-21T07:41:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:45 smithi123 ceph-mon[34166]: pgmap v552: 97 pgs: 97 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.8 MiB/s wr, 299 op/s 2024-09-21T07:41:47.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 948085 13.96 MB/sec execute 244 sec latency 19.576 ms 2024-09-21T07:41:48.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 950087 13.95 MB/sec execute 245 sec latency 46.513 ms 2024-09-21T07:41:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:47 smithi060 ceph-mon[31244]: pgmap v553: 97 pgs: 97 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 282 op/s 2024-09-21T07:41:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:47 smithi187 ceph-mon[34367]: pgmap v553: 97 pgs: 97 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 282 op/s 2024-09-21T07:41:48.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:47 smithi123 ceph-mon[34166]: pgmap v553: 97 pgs: 97 active+clean; 279 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 282 op/s 2024-09-21T07:41:49.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 952676 13.95 MB/sec execute 246 sec latency 69.980 ms 2024-09-21T07:41:50.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 955834 13.96 MB/sec execute 247 sec latency 17.070 ms 2024-09-21T07:41:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:49 smithi060 ceph-mon[31244]: pgmap v554: 97 pgs: 97 active+clean; 280 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:41:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:49 smithi187 ceph-mon[34367]: pgmap v554: 97 pgs: 97 active+clean; 280 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:41:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:49 smithi123 ceph-mon[34166]: pgmap v554: 97 pgs: 97 active+clean; 280 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:41:51.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 958504 13.96 MB/sec execute 248 sec latency 14.257 ms 2024-09-21T07:41:52.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 960733 13.96 MB/sec execute 249 sec latency 43.999 ms 2024-09-21T07:41:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:51 smithi060 ceph-mon[31244]: pgmap v555: 97 pgs: 97 active+clean; 280 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-21T07:41:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:51 smithi187 ceph-mon[34367]: pgmap v555: 97 pgs: 97 active+clean; 280 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-21T07:41:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:51 smithi123 ceph-mon[34166]: pgmap v555: 97 pgs: 97 active+clean; 280 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-21T07:41:53.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 963502 13.96 MB/sec execute 250 sec latency 15.143 ms 2024-09-21T07:41:54.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 966341 13.97 MB/sec execute 251 sec latency 66.976 ms 2024-09-21T07:41:54.151 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:53 smithi123 ceph-mon[34166]: pgmap v556: 97 pgs: 97 active+clean; 284 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-21T07:41:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:53 smithi187 ceph-mon[34367]: pgmap v556: 97 pgs: 97 active+clean; 284 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-21T07:41:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:53 smithi060 ceph-mon[31244]: pgmap v556: 97 pgs: 97 active+clean; 284 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-21T07:41:55.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 968954 13.95 MB/sec execute 252 sec latency 15.804 ms 2024-09-21T07:41:56.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 971533 13.96 MB/sec execute 253 sec latency 11.026 ms 2024-09-21T07:41:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:55 smithi187 ceph-mon[34367]: pgmap v557: 97 pgs: 97 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 3.2 MiB/s wr, 228 op/s 2024-09-21T07:41:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:55 smithi123 ceph-mon[34166]: pgmap v557: 97 pgs: 97 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 3.2 MiB/s wr, 228 op/s 2024-09-21T07:41:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:55 smithi060 ceph-mon[31244]: pgmap v557: 97 pgs: 97 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 3.2 MiB/s wr, 228 op/s 2024-09-21T07:41:57.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 974157 13.96 MB/sec execute 254 sec latency 22.017 ms 2024-09-21T07:41:58.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 977323 13.98 MB/sec execute 255 sec latency 10.071 ms 2024-09-21T07:41:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:57 smithi187 ceph-mon[34367]: pgmap v558: 97 pgs: 97 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-09-21T07:41:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:57 smithi123 ceph-mon[34166]: pgmap v558: 97 pgs: 97 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-09-21T07:41:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:57 smithi060 ceph-mon[31244]: pgmap v558: 97 pgs: 97 active+clean; 281 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 3.4 MiB/s wr, 237 op/s 2024-09-21T07:41:59.104 INFO:tasks.workunit.client.0.smithi060.stdout: 1 979486 13.96 MB/sec execute 256 sec latency 73.602 ms 2024-09-21T07:42:00.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 982076 13.97 MB/sec execute 257 sec latency 19.624 ms 2024-09-21T07:42:00.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:41:59 smithi187 ceph-mon[34367]: pgmap v559: 97 pgs: 97 active+clean; 288 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 3.7 MiB/s wr, 264 op/s 2024-09-21T07:42:00.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:41:59 smithi123 ceph-mon[34166]: pgmap v559: 97 pgs: 97 active+clean; 288 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 3.7 MiB/s wr, 264 op/s 2024-09-21T07:42:00.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:41:59 smithi060 ceph-mon[31244]: pgmap v559: 97 pgs: 97 active+clean; 288 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 3.7 MiB/s wr, 264 op/s 2024-09-21T07:42:01.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 984909 13.97 MB/sec execute 258 sec latency 11.400 ms 2024-09-21T07:42:02.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 988045 13.99 MB/sec execute 259 sec latency 15.287 ms 2024-09-21T07:42:02.173 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:01 smithi060 ceph-mon[31244]: pgmap v560: 97 pgs: 97 active+clean; 288 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 3.0 MiB/s wr, 231 op/s 2024-09-21T07:42:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:01 smithi187 ceph-mon[34367]: pgmap v560: 97 pgs: 97 active+clean; 288 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 3.0 MiB/s wr, 231 op/s 2024-09-21T07:42:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:01 smithi123 ceph-mon[34166]: pgmap v560: 97 pgs: 97 active+clean; 288 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 3.0 MiB/s wr, 231 op/s 2024-09-21T07:42:03.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 991046 13.99 MB/sec execute 260 sec latency 11.703 ms 2024-09-21T07:42:04.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 992386 13.96 MB/sec execute 261 sec latency 107.271 ms 2024-09-21T07:42:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:03 smithi187 ceph-mon[34367]: pgmap v561: 97 pgs: 97 active+clean; 278 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 313 op/s 2024-09-21T07:42:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:03 smithi123 ceph-mon[34166]: pgmap v561: 97 pgs: 97 active+clean; 278 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 313 op/s 2024-09-21T07:42:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:03 smithi060 ceph-mon[31244]: pgmap v561: 97 pgs: 97 active+clean; 278 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 313 op/s 2024-09-21T07:42:05.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 995209 13.97 MB/sec execute 262 sec latency 15.305 ms 2024-09-21T07:42:05.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:04 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:05.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:04 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:05.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:04 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:42:06.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 998264 13.99 MB/sec execute 263 sec latency 11.840 ms 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: pgmap v562: 97 pgs: 97 active+clean; 260 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi187 to 176.0M 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: Unable to set osd_memory_target on smithi123 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: Unable to set osd_memory_target on smithi187 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:06.271 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:42:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: pgmap v562: 97 pgs: 97 active+clean; 260 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2024-09-21T07:42:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi187 to 176.0M 2024-09-21T07:42:06.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: Unable to set osd_memory_target on smithi123 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-21T07:42:06.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:42:06.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: Unable to set osd_memory_target on smithi187 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T07:42:06.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:06.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:06.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: pgmap v562: 97 pgs: 97 active+clean; 260 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi187 to 176.0M 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: Unable to set osd_memory_target on smithi123 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: Unable to set osd_memory_target on smithi187 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:42:06.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:42:07.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1000764 13.97 MB/sec execute 264 sec latency 12.744 ms 2024-09-21T07:42:08.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1002791 13.96 MB/sec execute 265 sec latency 28.846 ms 2024-09-21T07:42:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:07 smithi187 ceph-mon[34367]: pgmap v563: 97 pgs: 97 active+clean; 260 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.6 MiB/s wr, 259 op/s 2024-09-21T07:42:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:07 smithi123 ceph-mon[34166]: pgmap v563: 97 pgs: 97 active+clean; 260 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.6 MiB/s wr, 259 op/s 2024-09-21T07:42:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:07 smithi060 ceph-mon[31244]: pgmap v563: 97 pgs: 97 active+clean; 260 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.6 MiB/s wr, 259 op/s 2024-09-21T07:42:09.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1005229 13.96 MB/sec execute 266 sec latency 148.646 ms 2024-09-21T07:42:10.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1007082 13.95 MB/sec execute 267 sec latency 14.127 ms 2024-09-21T07:42:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:09 smithi187 ceph-mon[34367]: pgmap v564: 97 pgs: 97 active+clean; 263 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 312 op/s 2024-09-21T07:42:10.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:09 smithi123 ceph-mon[34166]: pgmap v564: 97 pgs: 97 active+clean; 263 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 312 op/s 2024-09-21T07:42:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:09 smithi060 ceph-mon[31244]: pgmap v564: 97 pgs: 97 active+clean; 263 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.9 MiB/s wr, 312 op/s 2024-09-21T07:42:11.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1009480 13.95 MB/sec execute 268 sec latency 11.301 ms 2024-09-21T07:42:12.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1012167 13.94 MB/sec execute 269 sec latency 16.122 ms 2024-09-21T07:42:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:11 smithi187 ceph-mon[34367]: pgmap v565: 97 pgs: 97 active+clean; 263 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:42:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:11 smithi123 ceph-mon[34166]: pgmap v565: 97 pgs: 97 active+clean; 263 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:42:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:11 smithi060 ceph-mon[31244]: pgmap v565: 97 pgs: 97 active+clean; 263 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:42:13.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1014142 13.93 MB/sec execute 270 sec latency 17.026 ms 2024-09-21T07:42:14.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1016445 13.93 MB/sec execute 271 sec latency 55.353 ms 2024-09-21T07:42:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:13 smithi187 ceph-mon[34367]: pgmap v566: 97 pgs: 97 active+clean; 278 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-09-21T07:42:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:13 smithi123 ceph-mon[34166]: pgmap v566: 97 pgs: 97 active+clean; 278 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-09-21T07:42:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:13 smithi060 ceph-mon[31244]: pgmap v566: 97 pgs: 97 active+clean; 278 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-09-21T07:42:15.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1019386 13.94 MB/sec execute 272 sec latency 22.113 ms 2024-09-21T07:42:16.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1021578 13.92 MB/sec execute 273 sec latency 12.212 ms 2024-09-21T07:42:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:15 smithi187 ceph-mon[34367]: pgmap v567: 97 pgs: 97 active+clean; 285 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 234 op/s 2024-09-21T07:42:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:15 smithi123 ceph-mon[34166]: pgmap v567: 97 pgs: 97 active+clean; 285 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 234 op/s 2024-09-21T07:42:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:15 smithi060 ceph-mon[31244]: pgmap v567: 97 pgs: 97 active+clean; 285 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.7 MiB/s wr, 234 op/s 2024-09-21T07:42:17.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1023860 13.92 MB/sec execute 274 sec latency 14.753 ms 2024-09-21T07:42:18.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1026909 13.94 MB/sec execute 275 sec latency 11.667 ms 2024-09-21T07:42:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:17 smithi187 ceph-mon[34367]: pgmap v568: 97 pgs: 97 active+clean; 286 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 259 op/s 2024-09-21T07:42:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:17 smithi123 ceph-mon[34166]: pgmap v568: 97 pgs: 97 active+clean; 286 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 259 op/s 2024-09-21T07:42:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:17 smithi060 ceph-mon[31244]: pgmap v568: 97 pgs: 97 active+clean; 286 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 259 op/s 2024-09-21T07:42:19.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1029056 13.91 MB/sec execute 276 sec latency 107.364 ms 2024-09-21T07:42:20.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1031037 13.91 MB/sec execute 277 sec latency 17.974 ms 2024-09-21T07:42:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:19 smithi187 ceph-mon[34367]: pgmap v569: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.5 MiB/s wr, 305 op/s 2024-09-21T07:42:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:19 smithi123 ceph-mon[34166]: pgmap v569: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.5 MiB/s wr, 305 op/s 2024-09-21T07:42:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:19 smithi060 ceph-mon[31244]: pgmap v569: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.5 MiB/s wr, 305 op/s 2024-09-21T07:42:21.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1034071 13.93 MB/sec execute 278 sec latency 8.867 ms 2024-09-21T07:42:22.105 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1036801 13.92 MB/sec execute 279 sec latency 12.311 ms 2024-09-21T07:42:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:21 smithi187 ceph-mon[34367]: pgmap v570: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 226 op/s 2024-09-21T07:42:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:21 smithi123 ceph-mon[34166]: pgmap v570: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 226 op/s 2024-09-21T07:42:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:21 smithi060 ceph-mon[31244]: pgmap v570: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 226 op/s 2024-09-21T07:42:23.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1038959 13.91 MB/sec execute 280 sec latency 22.978 ms 2024-09-21T07:42:24.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1041283 13.91 MB/sec execute 281 sec latency 51.850 ms 2024-09-21T07:42:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:23 smithi187 ceph-mon[34367]: pgmap v571: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2024-09-21T07:42:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:23 smithi123 ceph-mon[34166]: pgmap v571: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2024-09-21T07:42:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:23 smithi060 ceph-mon[31244]: pgmap v571: 97 pgs: 97 active+clean; 290 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.2 MiB/s wr, 264 op/s 2024-09-21T07:42:25.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1044046 13.91 MB/sec execute 282 sec latency 25.877 ms 2024-09-21T07:42:26.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1045945 13.90 MB/sec execute 283 sec latency 90.332 ms 2024-09-21T07:42:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:25 smithi187 ceph-mon[34367]: pgmap v572: 97 pgs: 97 active+clean; 294 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 264 op/s 2024-09-21T07:42:26.352 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:25 smithi123 ceph-mon[34166]: pgmap v572: 97 pgs: 97 active+clean; 294 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 264 op/s 2024-09-21T07:42:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:25 smithi060 ceph-mon[31244]: pgmap v572: 97 pgs: 97 active+clean; 294 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 264 op/s 2024-09-21T07:42:27.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1048570 13.90 MB/sec execute 284 sec latency 7.466 ms 2024-09-21T07:42:28.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1051647 13.92 MB/sec execute 285 sec latency 11.608 ms 2024-09-21T07:42:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:27 smithi187 ceph-mon[34367]: pgmap v573: 97 pgs: 97 active+clean; 292 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 300 op/s 2024-09-21T07:42:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:27 smithi123 ceph-mon[34166]: pgmap v573: 97 pgs: 97 active+clean; 292 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 300 op/s 2024-09-21T07:42:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:27 smithi060 ceph-mon[31244]: pgmap v573: 97 pgs: 97 active+clean; 292 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 300 op/s 2024-09-21T07:42:29.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1053354 13.89 MB/sec execute 286 sec latency 48.212 ms 2024-09-21T07:42:30.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1055656 13.89 MB/sec execute 287 sec latency 28.962 ms 2024-09-21T07:42:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:29 smithi187 ceph-mon[34367]: pgmap v574: 97 pgs: 97 active+clean; 272 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:42:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:29 smithi123 ceph-mon[34166]: pgmap v574: 97 pgs: 97 active+clean; 272 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:42:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:29 smithi060 ceph-mon[31244]: pgmap v574: 97 pgs: 97 active+clean; 272 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:42:31.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1058718 13.90 MB/sec execute 288 sec latency 17.004 ms 2024-09-21T07:42:32.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1061028 13.88 MB/sec execute 289 sec latency 20.739 ms 2024-09-21T07:42:32.173 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:31 smithi060 ceph-mon[31244]: pgmap v575: 97 pgs: 97 active+clean; 272 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 202 op/s 2024-09-21T07:42:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:31 smithi187 ceph-mon[34367]: pgmap v575: 97 pgs: 97 active+clean; 272 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 202 op/s 2024-09-21T07:42:32.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:31 smithi123 ceph-mon[34166]: pgmap v575: 97 pgs: 97 active+clean; 272 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 202 op/s 2024-09-21T07:42:33.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1063127 13.88 MB/sec execute 290 sec latency 12.832 ms 2024-09-21T07:42:34.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1066065 13.90 MB/sec execute 291 sec latency 36.311 ms 2024-09-21T07:42:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:33 smithi187 ceph-mon[34367]: pgmap v576: 97 pgs: 97 active+clean; 274 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-09-21T07:42:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:33 smithi123 ceph-mon[34166]: pgmap v576: 97 pgs: 97 active+clean; 274 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-09-21T07:42:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:33 smithi060 ceph-mon[31244]: pgmap v576: 97 pgs: 97 active+clean; 274 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-09-21T07:42:35.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1068297 13.88 MB/sec execute 292 sec latency 48.289 ms 2024-09-21T07:42:36.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1070346 13.87 MB/sec execute 293 sec latency 40.530 ms 2024-09-21T07:42:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:35 smithi187 ceph-mon[34367]: pgmap v577: 97 pgs: 97 active+clean; 278 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 299 op/s 2024-09-21T07:42:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:35 smithi123 ceph-mon[34166]: pgmap v577: 97 pgs: 97 active+clean; 278 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 299 op/s 2024-09-21T07:42:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:35 smithi060 ceph-mon[31244]: pgmap v577: 97 pgs: 97 active+clean; 278 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 299 op/s 2024-09-21T07:42:37.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1073102 13.88 MB/sec execute 294 sec latency 10.143 ms 2024-09-21T07:42:38.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1075654 13.87 MB/sec execute 295 sec latency 55.027 ms 2024-09-21T07:42:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:37 smithi187 ceph-mon[34367]: pgmap v578: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 277 op/s 2024-09-21T07:42:38.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:37 smithi123 ceph-mon[34166]: pgmap v578: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 277 op/s 2024-09-21T07:42:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:37 smithi060 ceph-mon[31244]: pgmap v578: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 277 op/s 2024-09-21T07:42:39.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1077763 13.87 MB/sec execute 296 sec latency 11.864 ms 2024-09-21T07:42:40.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1078899 13.83 MB/sec execute 297 sec latency 248.508 ms 2024-09-21T07:42:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:39 smithi187 ceph-mon[34367]: pgmap v579: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 257 op/s 2024-09-21T07:42:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:39 smithi123 ceph-mon[34166]: pgmap v579: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 257 op/s 2024-09-21T07:42:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:39 smithi060 ceph-mon[31244]: pgmap v579: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 257 op/s 2024-09-21T07:42:41.106 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1081151 13.83 MB/sec execute 298 sec latency 16.813 ms 2024-09-21T07:42:42.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1083893 13.84 MB/sec execute 299 sec latency 13.075 ms 2024-09-21T07:42:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:41 smithi187 ceph-mon[34367]: pgmap v580: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-09-21T07:42:42.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:41 smithi123 ceph-mon[34166]: pgmap v580: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-09-21T07:42:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:41 smithi060 ceph-mon[31244]: pgmap v580: 97 pgs: 97 active+clean; 280 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-09-21T07:42:43.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1086794 13.85 MB/sec execute 300 sec latency 26.734 ms 2024-09-21T07:42:44.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1088940 13.83 MB/sec execute 301 sec latency 17.037 ms 2024-09-21T07:42:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:43 smithi187 ceph-mon[34367]: pgmap v581: 97 pgs: 97 active+clean; 281 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 286 op/s 2024-09-21T07:42:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:43 smithi123 ceph-mon[34166]: pgmap v581: 97 pgs: 97 active+clean; 281 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 286 op/s 2024-09-21T07:42:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:43 smithi060 ceph-mon[31244]: pgmap v581: 97 pgs: 97 active+clean; 281 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 286 op/s 2024-09-21T07:42:45.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1090953 13.83 MB/sec execute 302 sec latency 53.939 ms 2024-09-21T07:42:46.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1093865 13.83 MB/sec execute 303 sec latency 12.927 ms 2024-09-21T07:42:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:45 smithi187 ceph-mon[34367]: pgmap v582: 97 pgs: 97 active+clean; 285 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-21T07:42:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:45 smithi123 ceph-mon[34166]: pgmap v582: 97 pgs: 97 active+clean; 285 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-21T07:42:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:45 smithi060 ceph-mon[31244]: pgmap v582: 97 pgs: 97 active+clean; 285 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 298 op/s 2024-09-21T07:42:47.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1095051 13.81 MB/sec execute 304 sec latency 238.000 ms 2024-09-21T07:42:48.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:47 smithi187 ceph-mon[34367]: pgmap v583: 97 pgs: 97 active+clean; 285 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 250 op/s 2024-09-21T07:42:48.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:47 smithi123 ceph-mon[34166]: pgmap v583: 97 pgs: 97 active+clean; 285 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 250 op/s 2024-09-21T07:42:48.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1097941 13.82 MB/sec execute 305 sec latency 29.024 ms 2024-09-21T07:42:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:47 smithi060 ceph-mon[31244]: pgmap v583: 97 pgs: 97 active+clean; 285 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 250 op/s 2024-09-21T07:42:49.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1100533 13.82 MB/sec execute 306 sec latency 18.615 ms 2024-09-21T07:42:50.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:49 smithi123 ceph-mon[34166]: pgmap v584: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-09-21T07:42:50.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1102017 13.80 MB/sec execute 307 sec latency 110.948 ms 2024-09-21T07:42:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:49 smithi060 ceph-mon[31244]: pgmap v584: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-09-21T07:42:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:49 smithi187 ceph-mon[34367]: pgmap v584: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-09-21T07:42:51.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1105030 13.81 MB/sec execute 308 sec latency 13.697 ms 2024-09-21T07:42:52.070 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:51 smithi187 ceph-mon[34367]: pgmap v585: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 239 op/s 2024-09-21T07:42:52.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:51 smithi123 ceph-mon[34166]: pgmap v585: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 239 op/s 2024-09-21T07:42:52.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1107691 13.81 MB/sec execute 309 sec latency 14.076 ms 2024-09-21T07:42:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:51 smithi060 ceph-mon[31244]: pgmap v585: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 239 op/s 2024-09-21T07:42:53.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1109794 13.80 MB/sec execute 310 sec latency 12.423 ms 2024-09-21T07:42:54.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:53 smithi123 ceph-mon[34166]: pgmap v586: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-09-21T07:42:54.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1112378 13.80 MB/sec execute 311 sec latency 10.787 ms 2024-09-21T07:42:54.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:53 smithi060 ceph-mon[31244]: pgmap v586: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-09-21T07:42:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:53 smithi187 ceph-mon[34367]: pgmap v586: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-09-21T07:42:55.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1114795 13.80 MB/sec execute 312 sec latency 97.467 ms 2024-09-21T07:42:56.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:55 smithi123 ceph-mon[34166]: pgmap v587: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-09-21T07:42:56.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1116995 13.79 MB/sec execute 313 sec latency 12.178 ms 2024-09-21T07:42:56.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:55 smithi060 ceph-mon[31244]: pgmap v587: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-09-21T07:42:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:55 smithi187 ceph-mon[34367]: pgmap v587: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-09-21T07:42:57.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1119429 13.79 MB/sec execute 314 sec latency 54.940 ms 2024-09-21T07:42:58.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:57 smithi123 ceph-mon[34166]: pgmap v588: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-09-21T07:42:58.107 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1122502 13.80 MB/sec execute 315 sec latency 18.140 ms 2024-09-21T07:42:58.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:57 smithi060 ceph-mon[31244]: pgmap v588: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-09-21T07:42:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:57 smithi187 ceph-mon[34367]: pgmap v588: 97 pgs: 97 active+clean; 292 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 223 op/s 2024-09-21T07:42:59.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1124814 13.79 MB/sec execute 316 sec latency 20.529 ms 2024-09-21T07:43:00.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:42:59 smithi123 ceph-mon[34166]: pgmap v589: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:43:00.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1126434 13.78 MB/sec execute 317 sec latency 107.129 ms 2024-09-21T07:43:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:42:59 smithi060 ceph-mon[31244]: pgmap v589: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:43:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:42:59 smithi187 ceph-mon[34367]: pgmap v589: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:43:01.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1129305 13.78 MB/sec execute 318 sec latency 32.322 ms 2024-09-21T07:43:02.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:01 smithi123 ceph-mon[34166]: pgmap v590: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 220 op/s 2024-09-21T07:43:02.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1131284 13.77 MB/sec execute 319 sec latency 16.592 ms 2024-09-21T07:43:02.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:01 smithi060 ceph-mon[31244]: pgmap v590: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 220 op/s 2024-09-21T07:43:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:01 smithi187 ceph-mon[34367]: pgmap v590: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 220 op/s 2024-09-21T07:43:03.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1133843 13.77 MB/sec execute 320 sec latency 12.243 ms 2024-09-21T07:43:04.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:03 smithi123 ceph-mon[34166]: pgmap v591: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T07:43:04.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1136817 13.78 MB/sec execute 321 sec latency 11.203 ms 2024-09-21T07:43:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:03 smithi060 ceph-mon[31244]: pgmap v591: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T07:43:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:03 smithi187 ceph-mon[34367]: pgmap v591: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 254 op/s 2024-09-21T07:43:05.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1138794 13.76 MB/sec execute 322 sec latency 90.502 ms 2024-09-21T07:43:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:05 smithi123 ceph-mon[34166]: pgmap v592: 97 pgs: 97 active+clean; 277 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 258 op/s 2024-09-21T07:43:06.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:05 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:06.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1141075 13.76 MB/sec execute 323 sec latency 20.749 ms 2024-09-21T07:43:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:05 smithi060 ceph-mon[31244]: pgmap v592: 97 pgs: 97 active+clean; 277 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 258 op/s 2024-09-21T07:43:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:05 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:05 smithi187 ceph-mon[34367]: pgmap v592: 97 pgs: 97 active+clean; 277 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 258 op/s 2024-09-21T07:43:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:05 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:43:07.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:07.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:07.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:06 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:43:07.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1144119 13.78 MB/sec execute 324 sec latency 13.707 ms 2024-09-21T07:43:07.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:07.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:07.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:06 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:43:07.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:43:07.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:43:07.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:06 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:43:08.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1146953 13.78 MB/sec execute 325 sec latency 15.983 ms 2024-09-21T07:43:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:08 smithi187 ceph-mon[34367]: pgmap v593: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 251 op/s 2024-09-21T07:43:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:08 smithi123 ceph-mon[34166]: pgmap v593: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 251 op/s 2024-09-21T07:43:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:08 smithi060 ceph-mon[31244]: pgmap v593: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 251 op/s 2024-09-21T07:43:09.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1149271 13.77 MB/sec execute 326 sec latency 10.873 ms 2024-09-21T07:43:10.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1151502 13.77 MB/sec execute 327 sec latency 56.394 ms 2024-09-21T07:43:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:10 smithi187 ceph-mon[34367]: pgmap v594: 97 pgs: 97 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 309 op/s 2024-09-21T07:43:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:10 smithi123 ceph-mon[34166]: pgmap v594: 97 pgs: 97 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 309 op/s 2024-09-21T07:43:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:10 smithi060 ceph-mon[31244]: pgmap v594: 97 pgs: 97 active+clean; 281 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 309 op/s 2024-09-21T07:43:11.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1154637 13.78 MB/sec execute 328 sec latency 40.994 ms 2024-09-21T07:43:12.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1157388 13.78 MB/sec execute 329 sec latency 11.665 ms 2024-09-21T07:43:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:12 smithi187 ceph-mon[34367]: pgmap v595: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 215 op/s 2024-09-21T07:43:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:12 smithi123 ceph-mon[34166]: pgmap v595: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 215 op/s 2024-09-21T07:43:12.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:12 smithi060 ceph-mon[31244]: pgmap v595: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 215 op/s 2024-09-21T07:43:13.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1159457 13.78 MB/sec execute 330 sec latency 100.646 ms 2024-09-21T07:43:14.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1162082 13.78 MB/sec execute 331 sec latency 65.720 ms 2024-09-21T07:43:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:14 smithi187 ceph-mon[34367]: pgmap v596: 97 pgs: 97 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-09-21T07:43:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:14 smithi123 ceph-mon[34166]: pgmap v596: 97 pgs: 97 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-09-21T07:43:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:14 smithi060 ceph-mon[31244]: pgmap v596: 97 pgs: 97 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-09-21T07:43:15.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1165092 13.79 MB/sec execute 332 sec latency 63.475 ms 2024-09-21T07:43:16.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1167108 13.77 MB/sec execute 333 sec latency 39.186 ms 2024-09-21T07:43:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:16 smithi187 ceph-mon[34367]: pgmap v597: 97 pgs: 97 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 280 op/s 2024-09-21T07:43:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:16 smithi123 ceph-mon[34166]: pgmap v597: 97 pgs: 97 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 280 op/s 2024-09-21T07:43:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:16 smithi060 ceph-mon[31244]: pgmap v597: 97 pgs: 97 active+clean; 286 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 280 op/s 2024-09-21T07:43:17.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1169470 13.77 MB/sec execute 334 sec latency 13.071 ms 2024-09-21T07:43:18.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1172480 13.78 MB/sec execute 335 sec latency 16.193 ms 2024-09-21T07:43:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:18 smithi187 ceph-mon[34367]: pgmap v598: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-21T07:43:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:18 smithi123 ceph-mon[34166]: pgmap v598: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-21T07:43:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:18 smithi060 ceph-mon[31244]: pgmap v598: 97 pgs: 97 active+clean; 289 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-09-21T07:43:19.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1175131 13.78 MB/sec execute 336 sec latency 12.249 ms 2024-09-21T07:43:20.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1177166 13.77 MB/sec execute 337 sec latency 18.624 ms 2024-09-21T07:43:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:20 smithi187 ceph-mon[34367]: pgmap v599: 97 pgs: 97 active+clean; 292 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2024-09-21T07:43:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:20 smithi123 ceph-mon[34166]: pgmap v599: 97 pgs: 97 active+clean; 292 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2024-09-21T07:43:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:20 smithi060 ceph-mon[31244]: pgmap v599: 97 pgs: 97 active+clean; 292 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 305 op/s 2024-09-21T07:43:21.108 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1179575 13.77 MB/sec execute 338 sec latency 54.075 ms 2024-09-21T07:43:22.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1182131 13.77 MB/sec execute 339 sec latency 13.142 ms 2024-09-21T07:43:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:22 smithi187 ceph-mon[34367]: pgmap v600: 97 pgs: 97 active+clean; 291 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 229 op/s 2024-09-21T07:43:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:22 smithi123 ceph-mon[34166]: pgmap v600: 97 pgs: 97 active+clean; 291 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 229 op/s 2024-09-21T07:43:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:22 smithi060 ceph-mon[31244]: pgmap v600: 97 pgs: 97 active+clean; 291 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 229 op/s 2024-09-21T07:43:23.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1184158 13.76 MB/sec execute 340 sec latency 25.233 ms 2024-09-21T07:43:24.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1186744 13.76 MB/sec execute 341 sec latency 18.151 ms 2024-09-21T07:43:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:24 smithi187 ceph-mon[34367]: pgmap v601: 97 pgs: 97 active+clean; 294 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:43:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:24 smithi123 ceph-mon[34166]: pgmap v601: 97 pgs: 97 active+clean; 294 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:43:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:24 smithi060 ceph-mon[31244]: pgmap v601: 97 pgs: 97 active+clean; 294 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:43:25.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1189646 13.77 MB/sec execute 342 sec latency 20.473 ms 2024-09-21T07:43:26.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1191003 13.75 MB/sec execute 343 sec latency 57.676 ms 2024-09-21T07:43:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:26 smithi187 ceph-mon[34367]: pgmap v602: 97 pgs: 97 active+clean; 294 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 242 op/s 2024-09-21T07:43:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:26 smithi123 ceph-mon[34166]: pgmap v602: 97 pgs: 97 active+clean; 294 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 242 op/s 2024-09-21T07:43:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:26 smithi060 ceph-mon[31244]: pgmap v602: 97 pgs: 97 active+clean; 294 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 242 op/s 2024-09-21T07:43:27.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1193752 13.76 MB/sec execute 344 sec latency 9.507 ms 2024-09-21T07:43:28.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1196357 13.75 MB/sec execute 345 sec latency 17.702 ms 2024-09-21T07:43:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:28 smithi187 ceph-mon[34367]: pgmap v603: 97 pgs: 97 active+clean; 297 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 271 op/s 2024-09-21T07:43:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:28 smithi123 ceph-mon[34166]: pgmap v603: 97 pgs: 97 active+clean; 297 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 271 op/s 2024-09-21T07:43:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:28 smithi060 ceph-mon[31244]: pgmap v603: 97 pgs: 97 active+clean; 297 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 271 op/s 2024-09-21T07:43:29.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1198081 13.74 MB/sec execute 346 sec latency 40.106 ms 2024-09-21T07:43:30.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1200913 13.75 MB/sec execute 347 sec latency 8.968 ms 2024-09-21T07:43:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:30 smithi187 ceph-mon[34367]: pgmap v604: 97 pgs: 97 active+clean; 301 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 302 op/s 2024-09-21T07:43:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:30 smithi123 ceph-mon[34166]: pgmap v604: 97 pgs: 97 active+clean; 301 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 302 op/s 2024-09-21T07:43:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:30 smithi060 ceph-mon[31244]: pgmap v604: 97 pgs: 97 active+clean; 301 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 302 op/s 2024-09-21T07:43:31.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1203445 13.74 MB/sec execute 348 sec latency 53.847 ms 2024-09-21T07:43:32.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1205642 13.74 MB/sec execute 349 sec latency 15.596 ms 2024-09-21T07:43:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:32 smithi187 ceph-mon[34367]: pgmap v605: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 239 op/s 2024-09-21T07:43:32.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:32 smithi123 ceph-mon[34166]: pgmap v605: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 239 op/s 2024-09-21T07:43:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:32 smithi060 ceph-mon[31244]: pgmap v605: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 239 op/s 2024-09-21T07:43:33.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1208175 13.74 MB/sec execute 350 sec latency 8.188 ms 2024-09-21T07:43:34.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1211215 13.75 MB/sec execute 351 sec latency 15.848 ms 2024-09-21T07:43:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:34 smithi187 ceph-mon[34367]: pgmap v606: 97 pgs: 97 active+clean; 295 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:43:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:34 smithi123 ceph-mon[34166]: pgmap v606: 97 pgs: 97 active+clean; 295 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:43:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:34 smithi060 ceph-mon[31244]: pgmap v606: 97 pgs: 97 active+clean; 295 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:43:35.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1213510 13.73 MB/sec execute 352 sec latency 20.843 ms 2024-09-21T07:43:36.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1215328 13.73 MB/sec execute 353 sec latency 42.267 ms 2024-09-21T07:43:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:36 smithi187 ceph-mon[34367]: pgmap v607: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 241 op/s 2024-09-21T07:43:36.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:36 smithi123 ceph-mon[34166]: pgmap v607: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 241 op/s 2024-09-21T07:43:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:36 smithi060 ceph-mon[31244]: pgmap v607: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 241 op/s 2024-09-21T07:43:37.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1218280 13.74 MB/sec execute 354 sec latency 42.839 ms 2024-09-21T07:43:38.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1220587 13.73 MB/sec execute 355 sec latency 15.453 ms 2024-09-21T07:43:38.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:38 smithi187 ceph-mon[34367]: pgmap v608: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 247 op/s 2024-09-21T07:43:38.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:38 smithi123 ceph-mon[34166]: pgmap v608: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 247 op/s 2024-09-21T07:43:38.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:38 smithi060 ceph-mon[31244]: pgmap v608: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 247 op/s 2024-09-21T07:43:39.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1222476 13.72 MB/sec execute 356 sec latency 18.624 ms 2024-09-21T07:43:40.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1225437 13.73 MB/sec execute 357 sec latency 68.718 ms 2024-09-21T07:43:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:40 smithi187 ceph-mon[34367]: pgmap v609: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 298 op/s 2024-09-21T07:43:40.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:40 smithi123 ceph-mon[34166]: pgmap v609: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 298 op/s 2024-09-21T07:43:40.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:40 smithi060 ceph-mon[31244]: pgmap v609: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 298 op/s 2024-09-21T07:43:41.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1227280 13.71 MB/sec execute 358 sec latency 79.703 ms 2024-09-21T07:43:42.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1229541 13.71 MB/sec execute 359 sec latency 25.485 ms 2024-09-21T07:43:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:42 smithi187 ceph-mon[34367]: pgmap v610: 97 pgs: 97 active+clean; 283 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T07:43:42.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:42 smithi123 ceph-mon[34166]: pgmap v610: 97 pgs: 97 active+clean; 283 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T07:43:42.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:42 smithi060 ceph-mon[31244]: pgmap v610: 97 pgs: 97 active+clean; 283 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-09-21T07:43:43.109 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1232506 13.72 MB/sec execute 360 sec latency 30.820 ms 2024-09-21T07:43:44.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1234847 13.71 MB/sec execute 361 sec latency 13.020 ms 2024-09-21T07:43:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:44 smithi187 ceph-mon[34367]: pgmap v611: 97 pgs: 97 active+clean; 278 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-09-21T07:43:44.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:44 smithi123 ceph-mon[34166]: pgmap v611: 97 pgs: 97 active+clean; 278 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-09-21T07:43:44.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:44 smithi060 ceph-mon[31244]: pgmap v611: 97 pgs: 97 active+clean; 278 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-09-21T07:43:45.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1237166 13.71 MB/sec execute 362 sec latency 14.374 ms 2024-09-21T07:43:46.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1239871 13.72 MB/sec execute 363 sec latency 63.188 ms 2024-09-21T07:43:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:46 smithi187 ceph-mon[34367]: pgmap v612: 97 pgs: 97 active+clean; 282 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-09-21T07:43:46.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:46 smithi123 ceph-mon[34166]: pgmap v612: 97 pgs: 97 active+clean; 282 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-09-21T07:43:46.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:46 smithi060 ceph-mon[31244]: pgmap v612: 97 pgs: 97 active+clean; 282 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-09-21T07:43:47.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1242990 13.73 MB/sec execute 364 sec latency 16.548 ms 2024-09-21T07:43:48.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1245361 13.72 MB/sec execute 365 sec latency 12.823 ms 2024-09-21T07:43:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:48 smithi187 ceph-mon[34367]: pgmap v613: 97 pgs: 97 active+clean; 286 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:43:48.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:48 smithi123 ceph-mon[34166]: pgmap v613: 97 pgs: 97 active+clean; 286 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:43:48.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:48 smithi060 ceph-mon[31244]: pgmap v613: 97 pgs: 97 active+clean; 286 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:43:49.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1247441 13.71 MB/sec execute 366 sec latency 25.496 ms 2024-09-21T07:43:50.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1250460 13.73 MB/sec execute 367 sec latency 10.445 ms 2024-09-21T07:43:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:50 smithi187 ceph-mon[34367]: pgmap v614: 97 pgs: 97 active+clean; 286 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 306 op/s 2024-09-21T07:43:50.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:50 smithi123 ceph-mon[34166]: pgmap v614: 97 pgs: 97 active+clean; 286 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 306 op/s 2024-09-21T07:43:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:50 smithi060 ceph-mon[31244]: pgmap v614: 97 pgs: 97 active+clean; 286 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 306 op/s 2024-09-21T07:43:51.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1252673 13.71 MB/sec execute 368 sec latency 66.324 ms 2024-09-21T07:43:52.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1254772 13.71 MB/sec execute 369 sec latency 22.389 ms 2024-09-21T07:43:52.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:52 smithi187 ceph-mon[34367]: pgmap v615: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-09-21T07:43:52.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:52 smithi123 ceph-mon[34166]: pgmap v615: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-09-21T07:43:52.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:52 smithi060 ceph-mon[31244]: pgmap v615: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-09-21T07:43:53.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1257664 13.72 MB/sec execute 370 sec latency 13.324 ms 2024-09-21T07:43:54.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1260717 13.73 MB/sec execute 371 sec latency 18.718 ms 2024-09-21T07:43:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:54 smithi187 ceph-mon[34367]: pgmap v616: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 293 op/s 2024-09-21T07:43:54.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:54 smithi123 ceph-mon[34166]: pgmap v616: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 293 op/s 2024-09-21T07:43:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:54 smithi060 ceph-mon[31244]: pgmap v616: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.8 MiB/s wr, 293 op/s 2024-09-21T07:43:55.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1262734 13.71 MB/sec execute 372 sec latency 15.679 ms 2024-09-21T07:43:56.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1264856 13.71 MB/sec execute 373 sec latency 62.144 ms 2024-09-21T07:43:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:56 smithi187 ceph-mon[34367]: pgmap v617: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-09-21T07:43:56.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:56 smithi123 ceph-mon[34166]: pgmap v617: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-09-21T07:43:56.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:56 smithi060 ceph-mon[31244]: pgmap v617: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-09-21T07:43:57.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1267824 13.72 MB/sec execute 374 sec latency 36.167 ms 2024-09-21T07:43:58.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1269937 13.70 MB/sec execute 375 sec latency 17.115 ms 2024-09-21T07:43:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:43:58 smithi187 ceph-mon[34367]: pgmap v618: 97 pgs: 97 active+clean; 292 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.4 MiB/s wr, 255 op/s 2024-09-21T07:43:58.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:43:58 smithi123 ceph-mon[34166]: pgmap v618: 97 pgs: 97 active+clean; 292 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.4 MiB/s wr, 255 op/s 2024-09-21T07:43:58.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:43:58 smithi060 ceph-mon[31244]: pgmap v618: 97 pgs: 97 active+clean; 292 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.4 MiB/s wr, 255 op/s 2024-09-21T07:43:59.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1272130 13.70 MB/sec execute 376 sec latency 51.891 ms 2024-09-21T07:44:00.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1275189 13.72 MB/sec execute 377 sec latency 26.417 ms 2024-09-21T07:44:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:00 smithi187 ceph-mon[34367]: pgmap v619: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 274 op/s 2024-09-21T07:44:00.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:00 smithi123 ceph-mon[34166]: pgmap v619: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 274 op/s 2024-09-21T07:44:00.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:00 smithi060 ceph-mon[31244]: pgmap v619: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 274 op/s 2024-09-21T07:44:01.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1277927 13.71 MB/sec execute 378 sec latency 15.930 ms 2024-09-21T07:44:02.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1279621 13.70 MB/sec execute 379 sec latency 82.803 ms 2024-09-21T07:44:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:02 smithi187 ceph-mon[34367]: pgmap v620: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2024-09-21T07:44:02.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:02 smithi123 ceph-mon[34166]: pgmap v620: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2024-09-21T07:44:02.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:02 smithi060 ceph-mon[31244]: pgmap v620: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.0 MiB/s wr, 248 op/s 2024-09-21T07:44:03.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1282443 13.71 MB/sec execute 380 sec latency 15.170 ms 2024-09-21T07:44:04.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1285553 13.72 MB/sec execute 381 sec latency 12.329 ms 2024-09-21T07:44:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:04 smithi187 ceph-mon[34367]: pgmap v621: 97 pgs: 97 active+clean; 283 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 283 op/s 2024-09-21T07:44:04.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:04 smithi123 ceph-mon[34166]: pgmap v621: 97 pgs: 97 active+clean; 283 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 283 op/s 2024-09-21T07:44:04.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:04 smithi060 ceph-mon[31244]: pgmap v621: 97 pgs: 97 active+clean; 283 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.5 MiB/s wr, 283 op/s 2024-09-21T07:44:05.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1287950 13.71 MB/sec execute 382 sec latency 18.989 ms 2024-09-21T07:44:06.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1290099 13.71 MB/sec execute 383 sec latency 13.027 ms 2024-09-21T07:44:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:06 smithi187 ceph-mon[34367]: pgmap v622: 97 pgs: 97 active+clean; 275 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 244 op/s 2024-09-21T07:44:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:06 smithi123 ceph-mon[34166]: pgmap v622: 97 pgs: 97 active+clean; 275 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 244 op/s 2024-09-21T07:44:06.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:06 smithi060 ceph-mon[31244]: pgmap v622: 97 pgs: 97 active+clean; 275 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 244 op/s 2024-09-21T07:44:07.110 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1292874 13.72 MB/sec execute 384 sec latency 54.730 ms 2024-09-21T07:44:07.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:07 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:07.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:07 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:07.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:07 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:07.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:07 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:44:07.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:07 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:07.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:07 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:07.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:07 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:07.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:07 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:44:07.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:44:07.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:44:07.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:44:07.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:44:08.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1295169 13.70 MB/sec execute 385 sec latency 16.559 ms 2024-09-21T07:44:08.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:08 smithi187 ceph-mon[34367]: pgmap v623: 97 pgs: 97 active+clean; 279 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 310 op/s 2024-09-21T07:44:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:08 smithi123 ceph-mon[34166]: pgmap v623: 97 pgs: 97 active+clean; 279 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 310 op/s 2024-09-21T07:44:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:08 smithi060 ceph-mon[31244]: pgmap v623: 97 pgs: 97 active+clean; 279 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 310 op/s 2024-09-21T07:44:09.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1297230 13.70 MB/sec execute 386 sec latency 17.810 ms 2024-09-21T07:44:10.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1300049 13.71 MB/sec execute 387 sec latency 17.828 ms 2024-09-21T07:44:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:10 smithi187 ceph-mon[34367]: pgmap v624: 97 pgs: 97 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 285 op/s 2024-09-21T07:44:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:10 smithi123 ceph-mon[34166]: pgmap v624: 97 pgs: 97 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 285 op/s 2024-09-21T07:44:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:10 smithi060 ceph-mon[31244]: pgmap v624: 97 pgs: 97 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 285 op/s 2024-09-21T07:44:11.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1302412 13.70 MB/sec execute 388 sec latency 12.391 ms 2024-09-21T07:44:12.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1304086 13.69 MB/sec execute 389 sec latency 60.675 ms 2024-09-21T07:44:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:12 smithi187 ceph-mon[34367]: pgmap v625: 97 pgs: 97 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-09-21T07:44:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:12 smithi123 ceph-mon[34166]: pgmap v625: 97 pgs: 97 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-09-21T07:44:12.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:12 smithi060 ceph-mon[31244]: pgmap v625: 97 pgs: 97 active+clean; 279 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-09-21T07:44:13.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1306897 13.70 MB/sec execute 390 sec latency 25.801 ms 2024-09-21T07:44:14.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1308999 13.68 MB/sec execute 391 sec latency 12.242 ms 2024-09-21T07:44:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:14 smithi187 ceph-mon[34367]: pgmap v626: 97 pgs: 97 active+clean; 283 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 250 op/s 2024-09-21T07:44:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:14 smithi123 ceph-mon[34166]: pgmap v626: 97 pgs: 97 active+clean; 283 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 250 op/s 2024-09-21T07:44:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:14 smithi060 ceph-mon[31244]: pgmap v626: 97 pgs: 97 active+clean; 283 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 250 op/s 2024-09-21T07:44:15.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1311264 13.68 MB/sec execute 392 sec latency 15.428 ms 2024-09-21T07:44:16.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1314380 13.69 MB/sec execute 393 sec latency 11.392 ms 2024-09-21T07:44:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:16 smithi187 ceph-mon[34367]: pgmap v627: 97 pgs: 97 active+clean; 287 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 257 op/s 2024-09-21T07:44:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:16 smithi123 ceph-mon[34166]: pgmap v627: 97 pgs: 97 active+clean; 287 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 257 op/s 2024-09-21T07:44:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:16 smithi060 ceph-mon[31244]: pgmap v627: 97 pgs: 97 active+clean; 287 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 257 op/s 2024-09-21T07:44:17.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1316893 13.69 MB/sec execute 394 sec latency 102.413 ms 2024-09-21T07:44:18.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1318981 13.69 MB/sec execute 395 sec latency 16.812 ms 2024-09-21T07:44:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:18 smithi187 ceph-mon[34367]: pgmap v628: 97 pgs: 97 active+clean; 288 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 290 op/s 2024-09-21T07:44:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:18 smithi123 ceph-mon[34166]: pgmap v628: 97 pgs: 97 active+clean; 288 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 290 op/s 2024-09-21T07:44:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:18 smithi060 ceph-mon[31244]: pgmap v628: 97 pgs: 97 active+clean; 288 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 290 op/s 2024-09-21T07:44:19.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1321680 13.69 MB/sec execute 396 sec latency 11.623 ms 2024-09-21T07:44:20.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1324616 13.70 MB/sec execute 397 sec latency 19.766 ms 2024-09-21T07:44:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:20 smithi123 ceph-mon[34166]: pgmap v629: 97 pgs: 97 active+clean; 286 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-09-21T07:44:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:20 smithi060 ceph-mon[31244]: pgmap v629: 97 pgs: 97 active+clean; 286 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-09-21T07:44:20.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:20 smithi187 ceph-mon[34367]: pgmap v629: 97 pgs: 97 active+clean; 286 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-09-21T07:44:21.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1326529 13.68 MB/sec execute 398 sec latency 13.486 ms 2024-09-21T07:44:22.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1328621 13.68 MB/sec execute 399 sec latency 55.025 ms 2024-09-21T07:44:22.571 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:22 smithi187 ceph-mon[34367]: pgmap v630: 97 pgs: 97 active+clean; 286 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 216 op/s 2024-09-21T07:44:22.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:22 smithi123 ceph-mon[34166]: pgmap v630: 97 pgs: 97 active+clean; 286 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 216 op/s 2024-09-21T07:44:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:22 smithi060 ceph-mon[31244]: pgmap v630: 97 pgs: 97 active+clean; 286 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 216 op/s 2024-09-21T07:44:23.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1331197 13.68 MB/sec execute 400 sec latency 38.766 ms 2024-09-21T07:44:24.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1333461 13.67 MB/sec execute 401 sec latency 13.812 ms 2024-09-21T07:44:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:24 smithi123 ceph-mon[34166]: pgmap v631: 97 pgs: 97 active+clean; 289 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2024-09-21T07:44:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:24 smithi060 ceph-mon[31244]: pgmap v631: 97 pgs: 97 active+clean; 289 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2024-09-21T07:44:24.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:24 smithi187 ceph-mon[34367]: pgmap v631: 97 pgs: 97 active+clean; 289 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 268 op/s 2024-09-21T07:44:25.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1335670 13.67 MB/sec execute 402 sec latency 230.362 ms 2024-09-21T07:44:26.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1338633 13.68 MB/sec execute 403 sec latency 44.916 ms 2024-09-21T07:44:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:26 smithi123 ceph-mon[34166]: pgmap v632: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 297 op/s 2024-09-21T07:44:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:26 smithi060 ceph-mon[31244]: pgmap v632: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 297 op/s 2024-09-21T07:44:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:26 smithi187 ceph-mon[34367]: pgmap v632: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 297 op/s 2024-09-21T07:44:27.111 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1340506 13.67 MB/sec execute 404 sec latency 96.368 ms 2024-09-21T07:44:28.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1343028 13.67 MB/sec execute 405 sec latency 27.776 ms 2024-09-21T07:44:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:28 smithi123 ceph-mon[34166]: pgmap v633: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-09-21T07:44:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:28 smithi060 ceph-mon[31244]: pgmap v633: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-09-21T07:44:28.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:28 smithi187 ceph-mon[34367]: pgmap v633: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 284 op/s 2024-09-21T07:44:29.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1346025 13.68 MB/sec execute 406 sec latency 19.279 ms 2024-09-21T07:44:30.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1348202 13.66 MB/sec execute 407 sec latency 15.175 ms 2024-09-21T07:44:30.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:30 smithi123 ceph-mon[34166]: pgmap v634: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-09-21T07:44:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:30 smithi060 ceph-mon[31244]: pgmap v634: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-09-21T07:44:30.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:30 smithi187 ceph-mon[34367]: pgmap v634: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-09-21T07:44:31.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1350115 13.66 MB/sec execute 408 sec latency 12.661 ms 2024-09-21T07:44:32.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1352432 13.66 MB/sec execute 409 sec latency 100.773 ms 2024-09-21T07:44:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:32 smithi123 ceph-mon[34166]: pgmap v635: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-09-21T07:44:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:32 smithi060 ceph-mon[31244]: pgmap v635: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-09-21T07:44:32.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:32 smithi187 ceph-mon[34367]: pgmap v635: 97 pgs: 97 active+clean; 293 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-09-21T07:44:33.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1354094 13.64 MB/sec execute 410 sec latency 17.217 ms 2024-09-21T07:44:34.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1356831 13.65 MB/sec execute 411 sec latency 11.502 ms 2024-09-21T07:44:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:34 smithi123 ceph-mon[34166]: pgmap v636: 97 pgs: 97 active+clean; 292 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 276 op/s 2024-09-21T07:44:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:34 smithi060 ceph-mon[31244]: pgmap v636: 97 pgs: 97 active+clean; 292 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 276 op/s 2024-09-21T07:44:34.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:34 smithi187 ceph-mon[34367]: pgmap v636: 97 pgs: 97 active+clean; 292 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 276 op/s 2024-09-21T07:44:35.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1359134 13.64 MB/sec execute 412 sec latency 57.198 ms 2024-09-21T07:44:36.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1361271 13.64 MB/sec execute 413 sec latency 11.100 ms 2024-09-21T07:44:36.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:36 smithi123 ceph-mon[34166]: pgmap v637: 97 pgs: 97 active+clean; 278 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 286 op/s 2024-09-21T07:44:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:36 smithi060 ceph-mon[31244]: pgmap v637: 97 pgs: 97 active+clean; 278 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 286 op/s 2024-09-21T07:44:36.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:36 smithi187 ceph-mon[34367]: pgmap v637: 97 pgs: 97 active+clean; 278 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 286 op/s 2024-09-21T07:44:37.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1363889 13.65 MB/sec execute 414 sec latency 82.095 ms 2024-09-21T07:44:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:37 smithi187 ceph-mon[34367]: pgmap v638: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-09-21T07:44:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:37 smithi123 ceph-mon[34166]: pgmap v638: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-09-21T07:44:38.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1366132 13.63 MB/sec execute 415 sec latency 22.489 ms 2024-09-21T07:44:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:37 smithi060 ceph-mon[31244]: pgmap v638: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-09-21T07:44:39.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1368173 13.63 MB/sec execute 416 sec latency 13.258 ms 2024-09-21T07:44:40.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:39 smithi123 ceph-mon[34166]: pgmap v639: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 233 op/s 2024-09-21T07:44:40.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1371052 13.64 MB/sec execute 417 sec latency 15.619 ms 2024-09-21T07:44:40.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:39 smithi060 ceph-mon[31244]: pgmap v639: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 233 op/s 2024-09-21T07:44:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:39 smithi187 ceph-mon[34367]: pgmap v639: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 233 op/s 2024-09-21T07:44:41.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1373701 13.64 MB/sec execute 418 sec latency 14.510 ms 2024-09-21T07:44:42.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:41 smithi123 ceph-mon[34166]: pgmap v640: 97 pgs: 97 active+clean; 275 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 245 op/s 2024-09-21T07:44:42.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1375279 13.64 MB/sec execute 419 sec latency 45.687 ms 2024-09-21T07:44:42.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:41 smithi060 ceph-mon[31244]: pgmap v640: 97 pgs: 97 active+clean; 275 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 245 op/s 2024-09-21T07:44:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:41 smithi187 ceph-mon[34367]: pgmap v640: 97 pgs: 97 active+clean; 275 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 245 op/s 2024-09-21T07:44:43.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1377811 13.67 MB/sec execute 420 sec latency 84.249 ms 2024-09-21T07:44:44.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:43 smithi123 ceph-mon[34166]: pgmap v641: 97 pgs: 97 active+clean; 274 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 272 op/s 2024-09-21T07:44:44.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1380026 13.66 MB/sec execute 421 sec latency 11.855 ms 2024-09-21T07:44:44.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:43 smithi060 ceph-mon[31244]: pgmap v641: 97 pgs: 97 active+clean; 274 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 272 op/s 2024-09-21T07:44:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:43 smithi187 ceph-mon[34367]: pgmap v641: 97 pgs: 97 active+clean; 274 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 272 op/s 2024-09-21T07:44:45.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1382672 13.66 MB/sec execute 422 sec latency 87.128 ms 2024-09-21T07:44:46.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:45 smithi123 ceph-mon[34166]: pgmap v642: 97 pgs: 97 active+clean; 271 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:44:46.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1385890 13.68 MB/sec execute 423 sec latency 13.792 ms 2024-09-21T07:44:46.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:45 smithi060 ceph-mon[31244]: pgmap v642: 97 pgs: 97 active+clean; 271 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:44:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:45 smithi187 ceph-mon[34367]: pgmap v642: 97 pgs: 97 active+clean; 271 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 288 op/s 2024-09-21T07:44:47.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1388462 13.67 MB/sec execute 424 sec latency 11.647 ms 2024-09-21T07:44:48.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1390184 13.66 MB/sec execute 425 sec latency 108.517 ms 2024-09-21T07:44:48.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:47 smithi060 ceph-mon[31244]: pgmap v643: 97 pgs: 97 active+clean; 265 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 245 op/s 2024-09-21T07:44:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:47 smithi187 ceph-mon[34367]: pgmap v643: 97 pgs: 97 active+clean; 265 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 245 op/s 2024-09-21T07:44:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:47 smithi123 ceph-mon[34166]: pgmap v643: 97 pgs: 97 active+clean; 265 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 245 op/s 2024-09-21T07:44:49.112 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1393134 13.67 MB/sec execute 426 sec latency 22.930 ms 2024-09-21T07:44:50.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1395533 13.67 MB/sec execute 427 sec latency 17.095 ms 2024-09-21T07:44:50.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:49 smithi060 ceph-mon[31244]: pgmap v644: 97 pgs: 97 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:44:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:49 smithi187 ceph-mon[34367]: pgmap v644: 97 pgs: 97 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:44:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:49 smithi123 ceph-mon[34166]: pgmap v644: 97 pgs: 97 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:44:51.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1397539 13.66 MB/sec execute 428 sec latency 12.706 ms 2024-09-21T07:44:52.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1400279 13.66 MB/sec execute 429 sec latency 13.066 ms 2024-09-21T07:44:52.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:51 smithi060 ceph-mon[31244]: pgmap v645: 97 pgs: 97 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 234 op/s 2024-09-21T07:44:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:51 smithi187 ceph-mon[34367]: pgmap v645: 97 pgs: 97 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 234 op/s 2024-09-21T07:44:52.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:51 smithi123 ceph-mon[34166]: pgmap v645: 97 pgs: 97 active+clean; 270 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 234 op/s 2024-09-21T07:44:53.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1402344 13.65 MB/sec execute 430 sec latency 70.927 ms 2024-09-21T07:44:54.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1404229 13.65 MB/sec execute 431 sec latency 21.642 ms 2024-09-21T07:44:54.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:53 smithi060 ceph-mon[31244]: pgmap v646: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 243 op/s 2024-09-21T07:44:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:53 smithi187 ceph-mon[34367]: pgmap v646: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 243 op/s 2024-09-21T07:44:54.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:53 smithi123 ceph-mon[34166]: pgmap v646: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 243 op/s 2024-09-21T07:44:55.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1407112 13.66 MB/sec execute 432 sec latency 9.570 ms 2024-09-21T07:44:56.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1409386 13.64 MB/sec execute 433 sec latency 18.928 ms 2024-09-21T07:44:56.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:55 smithi060 ceph-mon[31244]: pgmap v647: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:44:56.151 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:55 smithi123 ceph-mon[34166]: pgmap v647: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:44:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:55 smithi187 ceph-mon[34367]: pgmap v647: 97 pgs: 97 active+clean; 272 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 266 op/s 2024-09-21T07:44:57.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1411515 13.64 MB/sec execute 434 sec latency 12.517 ms 2024-09-21T07:44:58.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1414205 13.65 MB/sec execute 435 sec latency 68.170 ms 2024-09-21T07:44:58.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:57 smithi060 ceph-mon[31244]: pgmap v648: 97 pgs: 97 active+clean; 273 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 3.4 MiB/s wr, 234 op/s 2024-09-21T07:44:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:57 smithi187 ceph-mon[34367]: pgmap v648: 97 pgs: 97 active+clean; 273 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 3.4 MiB/s wr, 234 op/s 2024-09-21T07:44:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:57 smithi123 ceph-mon[34166]: pgmap v648: 97 pgs: 97 active+clean; 273 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 3.4 MiB/s wr, 234 op/s 2024-09-21T07:44:59.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1415981 13.63 MB/sec execute 436 sec latency 31.703 ms 2024-09-21T07:45:00.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1418249 13.63 MB/sec execute 437 sec latency 41.667 ms 2024-09-21T07:45:00.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:44:59 smithi060 ceph-mon[31244]: pgmap v649: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.5 MiB/s wr, 258 op/s 2024-09-21T07:45:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:44:59 smithi187 ceph-mon[34367]: pgmap v649: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.5 MiB/s wr, 258 op/s 2024-09-21T07:45:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:44:59 smithi123 ceph-mon[34166]: pgmap v649: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 3.5 MiB/s wr, 258 op/s 2024-09-21T07:45:01.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1421294 13.64 MB/sec execute 438 sec latency 12.822 ms 2024-09-21T07:45:02.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1423608 13.63 MB/sec execute 439 sec latency 22.830 ms 2024-09-21T07:45:02.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:01 smithi060 ceph-mon[31244]: pgmap v650: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-21T07:45:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:01 smithi187 ceph-mon[34367]: pgmap v650: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-21T07:45:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:01 smithi123 ceph-mon[34166]: pgmap v650: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 2.9 MiB/s wr, 202 op/s 2024-09-21T07:45:03.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1425512 13.63 MB/sec execute 440 sec latency 62.232 ms 2024-09-21T07:45:04.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1428502 13.64 MB/sec execute 441 sec latency 26.400 ms 2024-09-21T07:45:04.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:03 smithi060 ceph-mon[31244]: pgmap v651: 97 pgs: 97 active+clean; 275 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 3.4 MiB/s wr, 263 op/s 2024-09-21T07:45:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:03 smithi187 ceph-mon[34367]: pgmap v651: 97 pgs: 97 active+clean; 275 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 3.4 MiB/s wr, 263 op/s 2024-09-21T07:45:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:03 smithi123 ceph-mon[34166]: pgmap v651: 97 pgs: 97 active+clean; 275 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 3.4 MiB/s wr, 263 op/s 2024-09-21T07:45:05.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1430877 13.63 MB/sec execute 442 sec latency 23.112 ms 2024-09-21T07:45:06.113 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1433070 13.63 MB/sec execute 443 sec latency 12.258 ms 2024-09-21T07:45:06.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:05 smithi060 ceph-mon[31244]: pgmap v652: 97 pgs: 97 active+clean; 276 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-09-21T07:45:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:05 smithi187 ceph-mon[34367]: pgmap v652: 97 pgs: 97 active+clean; 276 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-09-21T07:45:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:05 smithi123 ceph-mon[34166]: pgmap v652: 97 pgs: 97 active+clean; 276 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-09-21T07:45:07.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1435732 13.63 MB/sec execute 444 sec latency 22.050 ms 2024-09-21T07:45:07.913 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:07 smithi187 ceph-mon[34367]: pgmap v653: 97 pgs: 97 active+clean; 273 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 3.2 MiB/s wr, 224 op/s 2024-09-21T07:45:07.913 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:07 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:08.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1437136 13.62 MB/sec execute 445 sec latency 166.628 ms 2024-09-21T07:45:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:07 smithi060 ceph-mon[31244]: pgmap v653: 97 pgs: 97 active+clean; 273 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 3.2 MiB/s wr, 224 op/s 2024-09-21T07:45:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:07 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:07 smithi123 ceph-mon[34166]: pgmap v653: 97 pgs: 97 active+clean; 273 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 3.2 MiB/s wr, 224 op/s 2024-09-21T07:45:08.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:07 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:45:09.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1439198 13.61 MB/sec execute 446 sec latency 58.138 ms 2024-09-21T07:45:09.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:09 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:09 smithi123 ceph-mon[34166]: pgmap v654: 97 pgs: 97 active+clean; 256 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 3.5 MiB/s wr, 263 op/s 2024-09-21T07:45:09.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:09 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:09.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:09 smithi060 ceph-mon[31244]: pgmap v654: 97 pgs: 97 active+clean; 256 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 3.5 MiB/s wr, 263 op/s 2024-09-21T07:45:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:10.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:10.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:10.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:09 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:10.020 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:09 smithi187 ceph-mon[34367]: pgmap v654: 97 pgs: 97 active+clean; 256 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 3.5 MiB/s wr, 263 op/s 2024-09-21T07:45:10.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1441238 13.60 MB/sec execute 447 sec latency 52.240 ms 2024-09-21T07:45:11.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1443028 13.60 MB/sec execute 448 sec latency 54.108 ms 2024-09-21T07:45:12.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1444937 13.58 MB/sec execute 449 sec latency 93.330 ms 2024-09-21T07:45:12.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:11 smithi060 ceph-mon[31244]: pgmap v655: 97 pgs: 97 active+clean; 257 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-09-21T07:45:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:11 smithi187 ceph-mon[34367]: pgmap v655: 97 pgs: 97 active+clean; 257 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-09-21T07:45:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:11 smithi123 ceph-mon[34166]: pgmap v655: 97 pgs: 97 active+clean; 257 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 3.1 MiB/s wr, 220 op/s 2024-09-21T07:45:13.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1446471 13.58 MB/sec execute 450 sec latency 127.774 ms 2024-09-21T07:45:14.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1448927 13.58 MB/sec execute 451 sec latency 77.321 ms 2024-09-21T07:45:14.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:13 smithi060 ceph-mon[31244]: pgmap v656: 97 pgs: 97 active+clean; 256 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 3.4 MiB/s wr, 238 op/s 2024-09-21T07:45:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:13 smithi187 ceph-mon[34367]: pgmap v656: 97 pgs: 97 active+clean; 256 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 3.4 MiB/s wr, 238 op/s 2024-09-21T07:45:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:13 smithi123 ceph-mon[34166]: pgmap v656: 97 pgs: 97 active+clean; 256 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 3.4 MiB/s wr, 238 op/s 2024-09-21T07:45:15.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1450689 13.57 MB/sec execute 452 sec latency 13.631 ms 2024-09-21T07:45:15.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:15.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:15.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:15.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:45:15.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:45:15.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:45:16.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1453459 13.57 MB/sec execute 453 sec latency 16.127 ms 2024-09-21T07:45:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:16 smithi123 ceph-mon[34166]: pgmap v657: 97 pgs: 97 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 3.7 MiB/s wr, 228 op/s 2024-09-21T07:45:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:16 smithi060 ceph-mon[31244]: pgmap v657: 97 pgs: 97 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 3.7 MiB/s wr, 228 op/s 2024-09-21T07:45:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:16 smithi187 ceph-mon[34367]: pgmap v657: 97 pgs: 97 active+clean; 265 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 3.7 MiB/s wr, 228 op/s 2024-09-21T07:45:17.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1456037 13.57 MB/sec execute 454 sec latency 13.814 ms 2024-09-21T07:45:18.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1457541 13.56 MB/sec execute 455 sec latency 79.579 ms 2024-09-21T07:45:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:18 smithi123 ceph-mon[34166]: pgmap v658: 97 pgs: 97 active+clean; 273 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-09-21T07:45:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:18 smithi060 ceph-mon[31244]: pgmap v658: 97 pgs: 97 active+clean; 273 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-09-21T07:45:18.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:18 smithi187 ceph-mon[34367]: pgmap v658: 97 pgs: 97 active+clean; 273 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 4.3 MiB/s wr, 212 op/s 2024-09-21T07:45:19.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1460294 13.57 MB/sec execute 456 sec latency 52.783 ms 2024-09-21T07:45:20.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1462187 13.55 MB/sec execute 457 sec latency 16.316 ms 2024-09-21T07:45:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:20 smithi123 ceph-mon[34166]: pgmap v659: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2024-09-21T07:45:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:20 smithi060 ceph-mon[31244]: pgmap v659: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2024-09-21T07:45:20.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:20 smithi187 ceph-mon[34367]: pgmap v659: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2024-09-21T07:45:21.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1464424 13.55 MB/sec execute 458 sec latency 11.389 ms 2024-09-21T07:45:22.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1467379 13.56 MB/sec execute 459 sec latency 16.540 ms 2024-09-21T07:45:22.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:22 smithi123 ceph-mon[34166]: pgmap v660: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 199 op/s 2024-09-21T07:45:22.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:22 smithi060 ceph-mon[31244]: pgmap v660: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 199 op/s 2024-09-21T07:45:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:22 smithi187 ceph-mon[34367]: pgmap v660: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 199 op/s 2024-09-21T07:45:23.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1468996 13.55 MB/sec execute 460 sec latency 77.719 ms 2024-09-21T07:45:24.114 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1471313 13.55 MB/sec execute 461 sec latency 118.079 ms 2024-09-21T07:45:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:24 smithi123 ceph-mon[34166]: pgmap v661: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 223 op/s 2024-09-21T07:45:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:24 smithi060 ceph-mon[31244]: pgmap v661: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 223 op/s 2024-09-21T07:45:24.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:24 smithi187 ceph-mon[34367]: pgmap v661: 97 pgs: 97 active+clean; 282 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.6 MiB/s wr, 223 op/s 2024-09-21T07:45:25.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1474338 13.55 MB/sec execute 462 sec latency 15.284 ms 2024-09-21T07:45:26.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1476360 13.54 MB/sec execute 463 sec latency 17.552 ms 2024-09-21T07:45:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:26 smithi123 ceph-mon[34166]: pgmap v662: 97 pgs: 97 active+clean; 284 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 273 op/s 2024-09-21T07:45:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:26 smithi060 ceph-mon[31244]: pgmap v662: 97 pgs: 97 active+clean; 284 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 273 op/s 2024-09-21T07:45:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:26 smithi187 ceph-mon[34367]: pgmap v662: 97 pgs: 97 active+clean; 284 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.9 MiB/s wr, 273 op/s 2024-09-21T07:45:27.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1478664 13.54 MB/sec execute 464 sec latency 12.122 ms 2024-09-21T07:45:28.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1481617 13.55 MB/sec execute 465 sec latency 10.204 ms 2024-09-21T07:45:28.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:28 smithi123 ceph-mon[34166]: pgmap v663: 97 pgs: 97 active+clean; 283 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 238 op/s 2024-09-21T07:45:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:28 smithi060 ceph-mon[31244]: pgmap v663: 97 pgs: 97 active+clean; 283 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 238 op/s 2024-09-21T07:45:28.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:28 smithi187 ceph-mon[34367]: pgmap v663: 97 pgs: 97 active+clean; 283 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.2 MiB/s wr, 238 op/s 2024-09-21T07:45:29.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1483461 13.54 MB/sec execute 466 sec latency 62.285 ms 2024-09-21T07:45:30.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1485916 13.54 MB/sec execute 467 sec latency 18.100 ms 2024-09-21T07:45:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:30 smithi123 ceph-mon[34166]: pgmap v664: 97 pgs: 97 active+clean; 288 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 281 op/s 2024-09-21T07:45:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:30 smithi060 ceph-mon[31244]: pgmap v664: 97 pgs: 97 active+clean; 288 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 281 op/s 2024-09-21T07:45:30.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:30 smithi187 ceph-mon[34367]: pgmap v664: 97 pgs: 97 active+clean; 288 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 281 op/s 2024-09-21T07:45:31.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1488935 13.55 MB/sec execute 468 sec latency 12.146 ms 2024-09-21T07:45:32.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1491747 13.55 MB/sec execute 469 sec latency 14.077 ms 2024-09-21T07:45:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:32 smithi123 ceph-mon[34166]: pgmap v665: 97 pgs: 97 active+clean; 288 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-09-21T07:45:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:32 smithi060 ceph-mon[31244]: pgmap v665: 97 pgs: 97 active+clean; 288 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-09-21T07:45:32.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:32 smithi187 ceph-mon[34367]: pgmap v665: 97 pgs: 97 active+clean; 288 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 209 op/s 2024-09-21T07:45:33.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1494100 13.54 MB/sec execute 470 sec latency 11.560 ms 2024-09-21T07:45:34.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1496100 13.54 MB/sec execute 471 sec latency 69.080 ms 2024-09-21T07:45:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:34 smithi123 ceph-mon[34166]: pgmap v666: 97 pgs: 97 active+clean; 292 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:45:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:34 smithi060 ceph-mon[31244]: pgmap v666: 97 pgs: 97 active+clean; 292 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:45:34.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:34 smithi187 ceph-mon[34367]: pgmap v666: 97 pgs: 97 active+clean; 292 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 298 op/s 2024-09-21T07:45:35.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1499207 13.55 MB/sec execute 472 sec latency 19.178 ms 2024-09-21T07:45:36.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1501213 13.54 MB/sec execute 473 sec latency 61.783 ms 2024-09-21T07:45:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:36 smithi060 ceph-mon[31244]: pgmap v667: 97 pgs: 97 active+clean; 291 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 288 op/s 2024-09-21T07:45:36.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:36 smithi187 ceph-mon[34367]: pgmap v667: 97 pgs: 97 active+clean; 291 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 288 op/s 2024-09-21T07:45:36.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:36 smithi123 ceph-mon[34166]: pgmap v667: 97 pgs: 97 active+clean; 291 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 288 op/s 2024-09-21T07:45:37.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1503739 13.54 MB/sec execute 474 sec latency 12.027 ms 2024-09-21T07:45:38.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1506609 13.55 MB/sec execute 475 sec latency 53.005 ms 2024-09-21T07:45:38.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:38 smithi060 ceph-mon[31244]: pgmap v668: 97 pgs: 97 active+clean; 294 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 283 op/s 2024-09-21T07:45:38.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:38 smithi187 ceph-mon[34367]: pgmap v668: 97 pgs: 97 active+clean; 294 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 283 op/s 2024-09-21T07:45:38.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:38 smithi123 ceph-mon[34166]: pgmap v668: 97 pgs: 97 active+clean; 294 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 283 op/s 2024-09-21T07:45:39.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1508727 13.54 MB/sec execute 476 sec latency 113.293 ms 2024-09-21T07:45:40.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1510643 13.53 MB/sec execute 477 sec latency 18.373 ms 2024-09-21T07:45:40.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:40 smithi060 ceph-mon[31244]: pgmap v669: 97 pgs: 97 active+clean; 289 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-21T07:45:40.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:40 smithi187 ceph-mon[34367]: pgmap v669: 97 pgs: 97 active+clean; 289 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-21T07:45:40.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:40 smithi123 ceph-mon[34166]: pgmap v669: 97 pgs: 97 active+clean; 289 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-21T07:45:41.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1513673 13.54 MB/sec execute 478 sec latency 17.601 ms 2024-09-21T07:45:42.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1516332 13.54 MB/sec execute 479 sec latency 18.875 ms 2024-09-21T07:45:42.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:42 smithi060 ceph-mon[31244]: pgmap v670: 97 pgs: 97 active+clean; 290 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-21T07:45:42.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:42 smithi187 ceph-mon[34367]: pgmap v670: 97 pgs: 97 active+clean; 290 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-21T07:45:42.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:42 smithi123 ceph-mon[34166]: pgmap v670: 97 pgs: 97 active+clean; 290 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-09-21T07:45:43.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1518647 13.54 MB/sec execute 480 sec latency 11.016 ms 2024-09-21T07:45:44.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1520944 13.54 MB/sec execute 481 sec latency 83.257 ms 2024-09-21T07:45:44.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:44 smithi060 ceph-mon[31244]: pgmap v671: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.4 MiB/s wr, 313 op/s 2024-09-21T07:45:44.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:44 smithi187 ceph-mon[34367]: pgmap v671: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.4 MiB/s wr, 313 op/s 2024-09-21T07:45:44.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:44 smithi123 ceph-mon[34166]: pgmap v671: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.4 MiB/s wr, 313 op/s 2024-09-21T07:45:45.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1523485 13.54 MB/sec execute 482 sec latency 12.801 ms 2024-09-21T07:45:46.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1525736 13.53 MB/sec execute 483 sec latency 11.874 ms 2024-09-21T07:45:46.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:46 smithi060 ceph-mon[31244]: pgmap v672: 97 pgs: 97 active+clean; 274 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.9 MiB/s wr, 235 op/s 2024-09-21T07:45:46.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:46 smithi187 ceph-mon[34367]: pgmap v672: 97 pgs: 97 active+clean; 274 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.9 MiB/s wr, 235 op/s 2024-09-21T07:45:46.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:46 smithi123 ceph-mon[34166]: pgmap v672: 97 pgs: 97 active+clean; 274 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 2.9 MiB/s wr, 235 op/s 2024-09-21T07:45:47.115 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1528320 13.54 MB/sec execute 484 sec latency 12.888 ms 2024-09-21T07:45:48.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1531386 13.55 MB/sec execute 485 sec latency 11.488 ms 2024-09-21T07:45:48.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:48 smithi060 ceph-mon[31244]: pgmap v673: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.4 MiB/s wr, 294 op/s 2024-09-21T07:45:48.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:48 smithi187 ceph-mon[34367]: pgmap v673: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.4 MiB/s wr, 294 op/s 2024-09-21T07:45:48.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:48 smithi123 ceph-mon[34166]: pgmap v673: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.4 MiB/s wr, 294 op/s 2024-09-21T07:45:49.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1533515 13.53 MB/sec execute 486 sec latency 54.003 ms 2024-09-21T07:45:50.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1535545 13.53 MB/sec execute 487 sec latency 17.633 ms 2024-09-21T07:45:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:50 smithi060 ceph-mon[31244]: pgmap v674: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.3 MiB/s wr, 253 op/s 2024-09-21T07:45:50.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:50 smithi187 ceph-mon[34367]: pgmap v674: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.3 MiB/s wr, 253 op/s 2024-09-21T07:45:50.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:50 smithi123 ceph-mon[34166]: pgmap v674: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.3 MiB/s wr, 253 op/s 2024-09-21T07:45:51.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1538587 13.54 MB/sec execute 488 sec latency 7.767 ms 2024-09-21T07:45:52.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1541387 13.54 MB/sec execute 489 sec latency 20.423 ms 2024-09-21T07:45:52.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:52 smithi060 ceph-mon[31244]: pgmap v675: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-21T07:45:52.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:52 smithi187 ceph-mon[34367]: pgmap v675: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-21T07:45:52.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:52 smithi123 ceph-mon[34166]: pgmap v675: 97 pgs: 97 active+clean; 278 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-21T07:45:53.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1543358 13.54 MB/sec execute 490 sec latency 20.015 ms 2024-09-21T07:45:54.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1545736 13.54 MB/sec execute 491 sec latency 66.896 ms 2024-09-21T07:45:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:54 smithi060 ceph-mon[31244]: pgmap v676: 97 pgs: 97 active+clean; 283 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 308 op/s 2024-09-21T07:45:54.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:54 smithi187 ceph-mon[34367]: pgmap v676: 97 pgs: 97 active+clean; 283 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 308 op/s 2024-09-21T07:45:54.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:54 smithi123 ceph-mon[34166]: pgmap v676: 97 pgs: 97 active+clean; 283 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 3.6 MiB/s wr, 308 op/s 2024-09-21T07:45:55.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1548473 13.54 MB/sec execute 492 sec latency 26.328 ms 2024-09-21T07:45:56.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1550680 13.53 MB/sec execute 493 sec latency 13.562 ms 2024-09-21T07:45:56.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:56 smithi060 ceph-mon[31244]: pgmap v677: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-09-21T07:45:56.651 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:56 smithi123 ceph-mon[34166]: pgmap v677: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-09-21T07:45:56.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:56 smithi187 ceph-mon[34367]: pgmap v677: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-09-21T07:45:57.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1553132 13.53 MB/sec execute 494 sec latency 11.802 ms 2024-09-21T07:45:58.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1556166 13.54 MB/sec execute 495 sec latency 18.287 ms 2024-09-21T07:45:58.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:45:58 smithi060 ceph-mon[31244]: pgmap v678: 97 pgs: 97 active+clean; 286 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-21T07:45:58.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:45:58 smithi187 ceph-mon[34367]: pgmap v678: 97 pgs: 97 active+clean; 286 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-21T07:45:58.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:45:58 smithi123 ceph-mon[34166]: pgmap v678: 97 pgs: 97 active+clean; 286 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 290 op/s 2024-09-21T07:45:59.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1558395 13.53 MB/sec execute 496 sec latency 46.892 ms 2024-09-21T07:46:00.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1560461 13.53 MB/sec execute 497 sec latency 16.574 ms 2024-09-21T07:46:00.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:00 smithi187 ceph-mon[34367]: pgmap v679: 97 pgs: 97 active+clean; 286 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 239 op/s 2024-09-21T07:46:00.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:00 smithi123 ceph-mon[34166]: pgmap v679: 97 pgs: 97 active+clean; 286 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 239 op/s 2024-09-21T07:46:00.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:00 smithi060 ceph-mon[31244]: pgmap v679: 97 pgs: 97 active+clean; 286 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 239 op/s 2024-09-21T07:46:01.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1563361 13.54 MB/sec execute 498 sec latency 12.386 ms 2024-09-21T07:46:02.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1566204 13.54 MB/sec execute 499 sec latency 11.601 ms 2024-09-21T07:46:02.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:02 smithi187 ceph-mon[34367]: pgmap v680: 97 pgs: 97 active+clean; 288 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 241 op/s 2024-09-21T07:46:02.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:02 smithi123 ceph-mon[34166]: pgmap v680: 97 pgs: 97 active+clean; 288 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 241 op/s 2024-09-21T07:46:02.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:02 smithi060 ceph-mon[31244]: pgmap v680: 97 pgs: 97 active+clean; 288 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.0 MiB/s wr, 241 op/s 2024-09-21T07:46:03.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1568027 13.53 MB/sec execute 500 sec latency 16.042 ms 2024-09-21T07:46:04.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1570357 13.53 MB/sec execute 501 sec latency 90.990 ms 2024-09-21T07:46:04.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:04 smithi187 ceph-mon[34367]: pgmap v681: 97 pgs: 97 active+clean; 291 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 312 op/s 2024-09-21T07:46:04.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:04 smithi123 ceph-mon[34166]: pgmap v681: 97 pgs: 97 active+clean; 291 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 312 op/s 2024-09-21T07:46:04.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:04 smithi060 ceph-mon[31244]: pgmap v681: 97 pgs: 97 active+clean; 291 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 312 op/s 2024-09-21T07:46:05.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1572002 13.52 MB/sec execute 502 sec latency 34.281 ms 2024-09-21T07:46:06.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1574141 13.52 MB/sec execute 503 sec latency 12.211 ms 2024-09-21T07:46:06.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:06 smithi060 ceph-mon[31244]: pgmap v682: 97 pgs: 97 active+clean; 291 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 242 op/s 2024-09-21T07:46:06.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:06 smithi187 ceph-mon[34367]: pgmap v682: 97 pgs: 97 active+clean; 291 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 242 op/s 2024-09-21T07:46:06.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:06 smithi123 ceph-mon[34166]: pgmap v682: 97 pgs: 97 active+clean; 291 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 242 op/s 2024-09-21T07:46:07.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1576692 13.52 MB/sec execute 504 sec latency 23.322 ms 2024-09-21T07:46:08.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1578405 13.51 MB/sec execute 505 sec latency 12.248 ms 2024-09-21T07:46:08.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:08 smithi187 ceph-mon[34367]: pgmap v683: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-09-21T07:46:08.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:08 smithi123 ceph-mon[34166]: pgmap v683: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-09-21T07:46:08.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:08 smithi060 ceph-mon[31244]: pgmap v683: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-09-21T07:46:09.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1581180 13.51 MB/sec execute 506 sec latency 21.794 ms 2024-09-21T07:46:10.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1583537 13.51 MB/sec execute 507 sec latency 53.494 ms 2024-09-21T07:46:10.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:10 smithi187 ceph-mon[34367]: pgmap v684: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 250 op/s 2024-09-21T07:46:10.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:10 smithi123 ceph-mon[34166]: pgmap v684: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 250 op/s 2024-09-21T07:46:10.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:10 smithi060 ceph-mon[31244]: pgmap v684: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 250 op/s 2024-09-21T07:46:11.116 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1585919 13.51 MB/sec execute 508 sec latency 11.508 ms 2024-09-21T07:46:12.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1588532 13.51 MB/sec execute 509 sec latency 11.438 ms 2024-09-21T07:46:12.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:12 smithi187 ceph-mon[34367]: pgmap v685: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-09-21T07:46:12.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:12 smithi123 ceph-mon[34166]: pgmap v685: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-09-21T07:46:12.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:12 smithi060 ceph-mon[31244]: pgmap v685: 97 pgs: 97 active+clean; 294 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-09-21T07:46:13.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1591610 13.52 MB/sec execute 510 sec latency 11.301 ms 2024-09-21T07:46:14.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1594036 13.51 MB/sec execute 511 sec latency 15.489 ms 2024-09-21T07:46:14.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:14 smithi187 ceph-mon[34367]: pgmap v686: 97 pgs: 97 active+clean; 295 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-21T07:46:14.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:14 smithi123 ceph-mon[34166]: pgmap v686: 97 pgs: 97 active+clean; 295 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-21T07:46:14.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:14 smithi060 ceph-mon[31244]: pgmap v686: 97 pgs: 97 active+clean; 295 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 302 op/s 2024-09-21T07:46:15.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1595754 13.50 MB/sec execute 512 sec latency 68.104 ms 2024-09-21T07:46:15.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:15.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:15.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:46:15.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:15.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:16.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1598778 13.51 MB/sec execute 513 sec latency 8.995 ms 2024-09-21T07:46:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:16 smithi187 ceph-mon[34367]: pgmap v687: 97 pgs: 97 active+clean; 274 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 243 op/s 2024-09-21T07:46:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:16.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:16.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:16.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:16 smithi123 ceph-mon[34166]: pgmap v687: 97 pgs: 97 active+clean; 274 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 243 op/s 2024-09-21T07:46:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:16.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:16.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:16 smithi060 ceph-mon[31244]: pgmap v687: 97 pgs: 97 active+clean; 274 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 243 op/s 2024-09-21T07:46:16.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:46:16.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:46:16.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:46:17.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1601147 13.50 MB/sec execute 514 sec latency 18.310 ms 2024-09-21T07:46:18.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1603251 13.50 MB/sec execute 515 sec latency 13.750 ms 2024-09-21T07:46:18.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:18 smithi187 ceph-mon[34367]: pgmap v688: 97 pgs: 97 active+clean; 275 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 254 op/s 2024-09-21T07:46:18.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:18 smithi123 ceph-mon[34166]: pgmap v688: 97 pgs: 97 active+clean; 275 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 254 op/s 2024-09-21T07:46:18.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:18 smithi060 ceph-mon[31244]: pgmap v688: 97 pgs: 97 active+clean; 275 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 254 op/s 2024-09-21T07:46:19.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1606038 13.51 MB/sec execute 516 sec latency 12.885 ms 2024-09-21T07:46:20.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1608072 13.50 MB/sec execute 517 sec latency 94.668 ms 2024-09-21T07:46:20.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:20 smithi187 ceph-mon[34367]: pgmap v689: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-09-21T07:46:20.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:20 smithi123 ceph-mon[34166]: pgmap v689: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-09-21T07:46:20.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:20 smithi060 ceph-mon[31244]: pgmap v689: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-09-21T07:46:21.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1610103 13.50 MB/sec execute 518 sec latency 12.109 ms 2024-09-21T07:46:22.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1613066 13.51 MB/sec execute 519 sec latency 13.545 ms 2024-09-21T07:46:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:22 smithi187 ceph-mon[34367]: pgmap v690: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 240 op/s 2024-09-21T07:46:22.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:22 smithi123 ceph-mon[34166]: pgmap v690: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 240 op/s 2024-09-21T07:46:22.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:22 smithi060 ceph-mon[31244]: pgmap v690: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 240 op/s 2024-09-21T07:46:23.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1615725 13.50 MB/sec execute 520 sec latency 14.862 ms 2024-09-21T07:46:24.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1617680 13.50 MB/sec execute 521 sec latency 14.112 ms 2024-09-21T07:46:24.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:24 smithi187 ceph-mon[34367]: pgmap v691: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:46:24.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:24 smithi123 ceph-mon[34166]: pgmap v691: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:46:24.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:24 smithi060 ceph-mon[31244]: pgmap v691: 97 pgs: 97 active+clean; 279 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.6 MiB/s wr, 278 op/s 2024-09-21T07:46:25.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1620072 13.50 MB/sec execute 522 sec latency 88.679 ms 2024-09-21T07:46:26.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1622303 13.49 MB/sec execute 523 sec latency 16.183 ms 2024-09-21T07:46:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:26 smithi187 ceph-mon[34367]: pgmap v692: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 251 op/s 2024-09-21T07:46:26.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:26 smithi123 ceph-mon[34166]: pgmap v692: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 251 op/s 2024-09-21T07:46:26.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:26 smithi060 ceph-mon[31244]: pgmap v692: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 251 op/s 2024-09-21T07:46:27.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1624285 13.49 MB/sec execute 524 sec latency 12.476 ms 2024-09-21T07:46:28.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1627135 13.50 MB/sec execute 525 sec latency 12.480 ms 2024-09-21T07:46:28.749 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:28 smithi123 ceph-mon[34166]: pgmap v693: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 257 op/s 2024-09-21T07:46:28.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:28 smithi187 ceph-mon[34367]: pgmap v693: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 257 op/s 2024-09-21T07:46:28.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:28 smithi060 ceph-mon[31244]: pgmap v693: 97 pgs: 97 active+clean; 283 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 257 op/s 2024-09-21T07:46:29.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1629402 13.49 MB/sec execute 526 sec latency 21.838 ms 2024-09-21T07:46:30.117 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1631163 13.48 MB/sec execute 527 sec latency 85.590 ms 2024-09-21T07:46:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:30 smithi123 ceph-mon[34166]: pgmap v694: 97 pgs: 97 active+clean; 287 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 310 op/s 2024-09-21T07:46:30.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:30 smithi187 ceph-mon[34367]: pgmap v694: 97 pgs: 97 active+clean; 287 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 310 op/s 2024-09-21T07:46:30.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:30 smithi060 ceph-mon[31244]: pgmap v694: 97 pgs: 97 active+clean; 287 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 310 op/s 2024-09-21T07:46:31.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1634149 13.49 MB/sec execute 528 sec latency 14.097 ms 2024-09-21T07:46:32.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1636554 13.48 MB/sec execute 529 sec latency 14.921 ms 2024-09-21T07:46:32.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:32 smithi187 ceph-mon[34367]: pgmap v695: 97 pgs: 97 active+clean; 287 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 233 op/s 2024-09-21T07:46:32.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:32 smithi123 ceph-mon[34166]: pgmap v695: 97 pgs: 97 active+clean; 287 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 233 op/s 2024-09-21T07:46:32.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:32 smithi060 ceph-mon[31244]: pgmap v695: 97 pgs: 97 active+clean; 287 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 233 op/s 2024-09-21T07:46:33.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1638732 13.48 MB/sec execute 530 sec latency 16.872 ms 2024-09-21T07:46:34.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1641565 13.49 MB/sec execute 531 sec latency 33.972 ms 2024-09-21T07:46:34.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:34 smithi187 ceph-mon[34367]: pgmap v696: 97 pgs: 97 active+clean; 289 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 287 op/s 2024-09-21T07:46:34.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:34 smithi123 ceph-mon[34166]: pgmap v696: 97 pgs: 97 active+clean; 289 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 287 op/s 2024-09-21T07:46:34.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:34 smithi060 ceph-mon[31244]: pgmap v696: 97 pgs: 97 active+clean; 289 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 287 op/s 2024-09-21T07:46:35.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1644279 13.49 MB/sec execute 532 sec latency 47.803 ms 2024-09-21T07:46:36.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1646272 13.48 MB/sec execute 533 sec latency 29.592 ms 2024-09-21T07:46:36.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:36 smithi187 ceph-mon[34367]: pgmap v697: 97 pgs: 97 active+clean; 290 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 270 op/s 2024-09-21T07:46:36.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:36 smithi123 ceph-mon[34166]: pgmap v697: 97 pgs: 97 active+clean; 290 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 270 op/s 2024-09-21T07:46:36.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:36 smithi060 ceph-mon[31244]: pgmap v697: 97 pgs: 97 active+clean; 290 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 270 op/s 2024-09-21T07:46:37.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1648907 13.49 MB/sec execute 534 sec latency 12.072 ms 2024-09-21T07:46:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:37 smithi187 ceph-mon[34367]: pgmap v698: 97 pgs: 97 active+clean; 292 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 252 op/s 2024-09-21T07:46:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:37 smithi123 ceph-mon[34166]: pgmap v698: 97 pgs: 97 active+clean; 292 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 252 op/s 2024-09-21T07:46:38.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1651961 13.49 MB/sec execute 535 sec latency 10.264 ms 2024-09-21T07:46:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:37 smithi060 ceph-mon[31244]: pgmap v698: 97 pgs: 97 active+clean; 292 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 252 op/s 2024-09-21T07:46:39.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1654315 13.48 MB/sec execute 536 sec latency 54.196 ms 2024-09-21T07:46:40.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:39 smithi123 ceph-mon[34166]: pgmap v699: 97 pgs: 97 active+clean; 295 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-09-21T07:46:40.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1656182 13.48 MB/sec execute 537 sec latency 52.572 ms 2024-09-21T07:46:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:39 smithi187 ceph-mon[34367]: pgmap v699: 97 pgs: 97 active+clean; 295 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-09-21T07:46:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:39 smithi060 ceph-mon[31244]: pgmap v699: 97 pgs: 97 active+clean; 295 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-09-21T07:46:41.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1659087 13.49 MB/sec execute 538 sec latency 19.402 ms 2024-09-21T07:46:42.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1661736 13.49 MB/sec execute 539 sec latency 18.258 ms 2024-09-21T07:46:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:41 smithi187 ceph-mon[34367]: pgmap v700: 97 pgs: 97 active+clean; 295 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-21T07:46:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:41 smithi123 ceph-mon[34166]: pgmap v700: 97 pgs: 97 active+clean; 295 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-21T07:46:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:41 smithi060 ceph-mon[31244]: pgmap v700: 97 pgs: 97 active+clean; 295 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-09-21T07:46:43.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1663812 13.49 MB/sec execute 540 sec latency 16.193 ms 2024-09-21T07:46:44.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1666468 13.49 MB/sec execute 541 sec latency 8.902 ms 2024-09-21T07:46:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:43 smithi187 ceph-mon[34367]: pgmap v701: 97 pgs: 97 active+clean; 290 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 296 op/s 2024-09-21T07:46:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:43 smithi123 ceph-mon[34166]: pgmap v701: 97 pgs: 97 active+clean; 290 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 296 op/s 2024-09-21T07:46:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:43 smithi060 ceph-mon[31244]: pgmap v701: 97 pgs: 97 active+clean; 290 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 296 op/s 2024-09-21T07:46:45.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1669256 13.49 MB/sec execute 542 sec latency 72.474 ms 2024-09-21T07:46:46.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1671149 13.48 MB/sec execute 543 sec latency 26.393 ms 2024-09-21T07:46:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:45 smithi187 ceph-mon[34367]: pgmap v702: 97 pgs: 97 active+clean; 279 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 262 op/s 2024-09-21T07:46:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:45 smithi123 ceph-mon[34166]: pgmap v702: 97 pgs: 97 active+clean; 279 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 262 op/s 2024-09-21T07:46:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:45 smithi060 ceph-mon[31244]: pgmap v702: 97 pgs: 97 active+clean; 279 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.4 MiB/s wr, 262 op/s 2024-09-21T07:46:47.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1673691 13.48 MB/sec execute 544 sec latency 16.659 ms 2024-09-21T07:46:48.118 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1676356 13.48 MB/sec execute 545 sec latency 201.666 ms 2024-09-21T07:46:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:47 smithi187 ceph-mon[34367]: pgmap v703: 97 pgs: 97 active+clean; 272 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2024-09-21T07:46:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:47 smithi123 ceph-mon[34166]: pgmap v703: 97 pgs: 97 active+clean; 272 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2024-09-21T07:46:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:47 smithi060 ceph-mon[31244]: pgmap v703: 97 pgs: 97 active+clean; 272 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2024-09-21T07:46:49.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1678112 13.48 MB/sec execute 546 sec latency 217.815 ms 2024-09-21T07:46:50.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1680539 13.48 MB/sec execute 547 sec latency 41.894 ms 2024-09-21T07:46:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:49 smithi187 ceph-mon[34367]: pgmap v704: 97 pgs: 97 active+clean; 277 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:46:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:49 smithi123 ceph-mon[34166]: pgmap v704: 97 pgs: 97 active+clean; 277 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:46:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:49 smithi060 ceph-mon[31244]: pgmap v704: 97 pgs: 97 active+clean; 277 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 301 op/s 2024-09-21T07:46:51.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1682874 13.47 MB/sec execute 548 sec latency 57.817 ms 2024-09-21T07:46:52.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1684829 13.47 MB/sec execute 549 sec latency 13.858 ms 2024-09-21T07:46:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:51 smithi187 ceph-mon[34367]: pgmap v705: 97 pgs: 97 active+clean; 275 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 233 op/s 2024-09-21T07:46:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:51 smithi123 ceph-mon[34166]: pgmap v705: 97 pgs: 97 active+clean; 275 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 233 op/s 2024-09-21T07:46:52.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:51 smithi060 ceph-mon[31244]: pgmap v705: 97 pgs: 97 active+clean; 275 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 233 op/s 2024-09-21T07:46:53.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1687606 13.47 MB/sec execute 550 sec latency 9.147 ms 2024-09-21T07:46:54.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1690362 13.47 MB/sec execute 551 sec latency 17.158 ms 2024-09-21T07:46:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:53 smithi187 ceph-mon[34367]: pgmap v706: 97 pgs: 97 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 256 op/s 2024-09-21T07:46:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:53 smithi123 ceph-mon[34166]: pgmap v706: 97 pgs: 97 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 256 op/s 2024-09-21T07:46:54.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:53 smithi060 ceph-mon[31244]: pgmap v706: 97 pgs: 97 active+clean; 275 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 256 op/s 2024-09-21T07:46:55.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1692395 13.47 MB/sec execute 552 sec latency 17.955 ms 2024-09-21T07:46:56.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1694664 13.47 MB/sec execute 553 sec latency 53.279 ms 2024-09-21T07:46:56.150 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:55 smithi123 ceph-mon[34166]: pgmap v707: 97 pgs: 97 active+clean; 279 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-09-21T07:46:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:55 smithi187 ceph-mon[34367]: pgmap v707: 97 pgs: 97 active+clean; 279 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-09-21T07:46:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:55 smithi060 ceph-mon[31244]: pgmap v707: 97 pgs: 97 active+clean; 279 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-09-21T07:46:57.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1697559 13.47 MB/sec execute 554 sec latency 12.659 ms 2024-09-21T07:46:58.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1699513 13.47 MB/sec execute 555 sec latency 14.940 ms 2024-09-21T07:46:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:57 smithi187 ceph-mon[34367]: pgmap v708: 97 pgs: 97 active+clean; 282 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 257 op/s 2024-09-21T07:46:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:57 smithi123 ceph-mon[34166]: pgmap v708: 97 pgs: 97 active+clean; 282 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 257 op/s 2024-09-21T07:46:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:57 smithi060 ceph-mon[31244]: pgmap v708: 97 pgs: 97 active+clean; 282 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 257 op/s 2024-09-21T07:46:59.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1702048 13.47 MB/sec execute 556 sec latency 19.876 ms 2024-09-21T07:47:00.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1705170 13.48 MB/sec execute 557 sec latency 8.598 ms 2024-09-21T07:47:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:46:59 smithi187 ceph-mon[34367]: pgmap v709: 97 pgs: 97 active+clean; 285 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 309 op/s 2024-09-21T07:47:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:46:59 smithi123 ceph-mon[34166]: pgmap v709: 97 pgs: 97 active+clean; 285 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 309 op/s 2024-09-21T07:47:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:46:59 smithi060 ceph-mon[31244]: pgmap v709: 97 pgs: 97 active+clean; 285 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 309 op/s 2024-09-21T07:47:01.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1707058 13.46 MB/sec execute 558 sec latency 67.846 ms 2024-09-21T07:47:02.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1709221 13.46 MB/sec execute 559 sec latency 11.800 ms 2024-09-21T07:47:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:01 smithi187 ceph-mon[34367]: pgmap v710: 97 pgs: 97 active+clean; 284 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 221 op/s 2024-09-21T07:47:02.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:01 smithi123 ceph-mon[34166]: pgmap v710: 97 pgs: 97 active+clean; 284 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 221 op/s 2024-09-21T07:47:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:01 smithi060 ceph-mon[31244]: pgmap v710: 97 pgs: 97 active+clean; 284 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 221 op/s 2024-09-21T07:47:03.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1712260 13.47 MB/sec execute 560 sec latency 10.346 ms 2024-09-21T07:47:04.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1714928 13.47 MB/sec execute 561 sec latency 14.094 ms 2024-09-21T07:47:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:03 smithi187 ceph-mon[34367]: pgmap v711: 97 pgs: 97 active+clean; 286 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 274 op/s 2024-09-21T07:47:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:03 smithi123 ceph-mon[34166]: pgmap v711: 97 pgs: 97 active+clean; 286 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 274 op/s 2024-09-21T07:47:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:03 smithi060 ceph-mon[31244]: pgmap v711: 97 pgs: 97 active+clean; 286 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 274 op/s 2024-09-21T07:47:05.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1717038 13.47 MB/sec execute 562 sec latency 15.767 ms 2024-09-21T07:47:06.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1719418 13.47 MB/sec execute 563 sec latency 67.048 ms 2024-09-21T07:47:06.173 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:05 smithi060 ceph-mon[31244]: pgmap v712: 97 pgs: 97 active+clean; 286 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 274 op/s 2024-09-21T07:47:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:05 smithi187 ceph-mon[34367]: pgmap v712: 97 pgs: 97 active+clean; 286 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 274 op/s 2024-09-21T07:47:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:05 smithi123 ceph-mon[34166]: pgmap v712: 97 pgs: 97 active+clean; 286 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 274 op/s 2024-09-21T07:47:07.119 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1721865 13.46 MB/sec execute 564 sec latency 14.097 ms 2024-09-21T07:47:08.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1723880 13.46 MB/sec execute 565 sec latency 16.858 ms 2024-09-21T07:47:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:07 smithi187 ceph-mon[34367]: pgmap v713: 97 pgs: 97 active+clean; 289 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-09-21T07:47:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:07 smithi123 ceph-mon[34166]: pgmap v713: 97 pgs: 97 active+clean; 289 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-09-21T07:47:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:07 smithi060 ceph-mon[31244]: pgmap v713: 97 pgs: 97 active+clean; 289 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-09-21T07:47:09.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1726632 13.47 MB/sec execute 566 sec latency 7.633 ms 2024-09-21T07:47:10.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1729548 13.47 MB/sec execute 567 sec latency 18.579 ms 2024-09-21T07:47:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:09 smithi187 ceph-mon[34367]: pgmap v714: 97 pgs: 97 active+clean; 292 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 303 op/s 2024-09-21T07:47:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:09 smithi123 ceph-mon[34166]: pgmap v714: 97 pgs: 97 active+clean; 292 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 303 op/s 2024-09-21T07:47:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:09 smithi060 ceph-mon[31244]: pgmap v714: 97 pgs: 97 active+clean; 292 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 303 op/s 2024-09-21T07:47:11.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1730868 13.46 MB/sec execute 568 sec latency 106.716 ms 2024-09-21T07:47:12.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1733665 13.46 MB/sec execute 569 sec latency 9.763 ms 2024-09-21T07:47:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:11 smithi187 ceph-mon[34367]: pgmap v715: 97 pgs: 97 active+clean; 291 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 230 op/s 2024-09-21T07:47:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:11 smithi123 ceph-mon[34166]: pgmap v715: 97 pgs: 97 active+clean; 291 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 230 op/s 2024-09-21T07:47:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:11 smithi060 ceph-mon[31244]: pgmap v715: 97 pgs: 97 active+clean; 291 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 230 op/s 2024-09-21T07:47:13.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1736262 13.46 MB/sec execute 570 sec latency 40.270 ms 2024-09-21T07:47:14.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1738007 13.45 MB/sec execute 571 sec latency 55.975 ms 2024-09-21T07:47:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:13 smithi187 ceph-mon[34367]: pgmap v716: 97 pgs: 97 active+clean; 290 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 291 op/s 2024-09-21T07:47:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:13 smithi123 ceph-mon[34166]: pgmap v716: 97 pgs: 97 active+clean; 290 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 291 op/s 2024-09-21T07:47:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:13 smithi060 ceph-mon[31244]: pgmap v716: 97 pgs: 97 active+clean; 290 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.7 MiB/s wr, 291 op/s 2024-09-21T07:47:15.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1740764 13.46 MB/sec execute 572 sec latency 11.049 ms 2024-09-21T07:47:16.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1742707 13.45 MB/sec execute 573 sec latency 101.109 ms 2024-09-21T07:47:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:15 smithi187 ceph-mon[34367]: pgmap v717: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 256 op/s 2024-09-21T07:47:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:15 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:15 smithi123 ceph-mon[34166]: pgmap v717: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 256 op/s 2024-09-21T07:47:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:15 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:15 smithi060 ceph-mon[31244]: pgmap v717: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 256 op/s 2024-09-21T07:47:16.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:15 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:47:17.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1744599 13.44 MB/sec execute 574 sec latency 18.444 ms 2024-09-21T07:47:17.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:17.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:17.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:47:17.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:17.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:17.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:47:17.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:47:17.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:47:17.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:47:18.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1747578 13.45 MB/sec execute 575 sec latency 17.001 ms 2024-09-21T07:47:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:18 smithi187 ceph-mon[34367]: pgmap v718: 97 pgs: 97 active+clean; 280 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 274 op/s 2024-09-21T07:47:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:18 smithi123 ceph-mon[34166]: pgmap v718: 97 pgs: 97 active+clean; 280 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 274 op/s 2024-09-21T07:47:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:18 smithi060 ceph-mon[31244]: pgmap v718: 97 pgs: 97 active+clean; 280 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 274 op/s 2024-09-21T07:47:19.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1749853 13.44 MB/sec execute 576 sec latency 12.634 ms 2024-09-21T07:47:20.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1751796 13.44 MB/sec execute 577 sec latency 18.853 ms 2024-09-21T07:47:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:20 smithi187 ceph-mon[34367]: pgmap v719: 97 pgs: 97 active+clean; 277 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 267 op/s 2024-09-21T07:47:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:20 smithi123 ceph-mon[34166]: pgmap v719: 97 pgs: 97 active+clean; 277 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 267 op/s 2024-09-21T07:47:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:20 smithi060 ceph-mon[31244]: pgmap v719: 97 pgs: 97 active+clean; 277 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 267 op/s 2024-09-21T07:47:21.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1754698 13.45 MB/sec execute 578 sec latency 69.745 ms 2024-09-21T07:47:22.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1756996 13.44 MB/sec execute 579 sec latency 20.792 ms 2024-09-21T07:47:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:22 smithi187 ceph-mon[34367]: pgmap v720: 97 pgs: 97 active+clean; 276 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 198 op/s 2024-09-21T07:47:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:22 smithi123 ceph-mon[34166]: pgmap v720: 97 pgs: 97 active+clean; 276 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 198 op/s 2024-09-21T07:47:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:22 smithi060 ceph-mon[31244]: pgmap v720: 97 pgs: 97 active+clean; 276 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 198 op/s 2024-09-21T07:47:23.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1759115 13.44 MB/sec execute 580 sec latency 13.303 ms 2024-09-21T07:47:24.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1762088 13.45 MB/sec execute 581 sec latency 9.892 ms 2024-09-21T07:47:24.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:24 smithi187 ceph-mon[34367]: pgmap v721: 97 pgs: 97 active+clean; 280 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 282 op/s 2024-09-21T07:47:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:24 smithi123 ceph-mon[34166]: pgmap v721: 97 pgs: 97 active+clean; 280 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 282 op/s 2024-09-21T07:47:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:24 smithi060 ceph-mon[31244]: pgmap v721: 97 pgs: 97 active+clean; 280 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.8 MiB/s wr, 282 op/s 2024-09-21T07:47:25.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1764880 13.45 MB/sec execute 582 sec latency 13.231 ms 2024-09-21T07:47:26.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1766355 13.44 MB/sec execute 583 sec latency 91.033 ms 2024-09-21T07:47:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:26 smithi187 ceph-mon[34367]: pgmap v722: 97 pgs: 97 active+clean; 280 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 226 op/s 2024-09-21T07:47:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:26 smithi123 ceph-mon[34166]: pgmap v722: 97 pgs: 97 active+clean; 280 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 226 op/s 2024-09-21T07:47:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:26 smithi060 ceph-mon[31244]: pgmap v722: 97 pgs: 97 active+clean; 280 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 226 op/s 2024-09-21T07:47:27.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1769136 13.44 MB/sec execute 584 sec latency 14.839 ms 2024-09-21T07:47:28.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1771994 13.44 MB/sec execute 585 sec latency 12.897 ms 2024-09-21T07:47:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:28 smithi187 ceph-mon[34367]: pgmap v723: 97 pgs: 97 active+clean; 282 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 263 op/s 2024-09-21T07:47:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:28 smithi123 ceph-mon[34166]: pgmap v723: 97 pgs: 97 active+clean; 282 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 263 op/s 2024-09-21T07:47:28.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:28 smithi060 ceph-mon[31244]: pgmap v723: 97 pgs: 97 active+clean; 282 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.4 MiB/s wr, 263 op/s 2024-09-21T07:47:29.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1774526 13.44 MB/sec execute 586 sec latency 11.128 ms 2024-09-21T07:47:30.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1776675 13.44 MB/sec execute 587 sec latency 17.580 ms 2024-09-21T07:47:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:30 smithi187 ceph-mon[34367]: pgmap v724: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:47:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:30 smithi123 ceph-mon[34166]: pgmap v724: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:47:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:30 smithi060 ceph-mon[31244]: pgmap v724: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:47:31.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1779584 13.45 MB/sec execute 588 sec latency 55.859 ms 2024-09-21T07:47:32.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1781411 13.44 MB/sec execute 589 sec latency 71.013 ms 2024-09-21T07:47:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:32 smithi123 ceph-mon[34166]: pgmap v725: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.0 MiB/s wr, 250 op/s 2024-09-21T07:47:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:32 smithi060 ceph-mon[31244]: pgmap v725: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.0 MiB/s wr, 250 op/s 2024-09-21T07:47:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:32 smithi187 ceph-mon[34367]: pgmap v725: 97 pgs: 97 active+clean; 286 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.0 MiB/s wr, 250 op/s 2024-09-21T07:47:33.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1783788 13.44 MB/sec execute 590 sec latency 13.814 ms 2024-09-21T07:47:34.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1786818 13.45 MB/sec execute 591 sec latency 10.559 ms 2024-09-21T07:47:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:34 smithi123 ceph-mon[34166]: pgmap v726: 97 pgs: 97 active+clean; 288 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.7 MiB/s wr, 302 op/s 2024-09-21T07:47:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:34 smithi060 ceph-mon[31244]: pgmap v726: 97 pgs: 97 active+clean; 288 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.7 MiB/s wr, 302 op/s 2024-09-21T07:47:34.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:34 smithi187 ceph-mon[34367]: pgmap v726: 97 pgs: 97 active+clean; 288 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 3.7 MiB/s wr, 302 op/s 2024-09-21T07:47:35.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1789133 13.44 MB/sec execute 592 sec latency 26.966 ms 2024-09-21T07:47:36.120 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1791017 13.43 MB/sec execute 593 sec latency 19.594 ms 2024-09-21T07:47:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:36 smithi123 ceph-mon[34166]: pgmap v727: 97 pgs: 97 active+clean; 289 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T07:47:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:36 smithi060 ceph-mon[31244]: pgmap v727: 97 pgs: 97 active+clean; 289 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T07:47:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:36 smithi187 ceph-mon[34367]: pgmap v727: 97 pgs: 97 active+clean; 289 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-09-21T07:47:37.121 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1793569 13.44 MB/sec execute 594 sec latency 54.720 ms 2024-09-21T07:47:38.121 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1795310 13.43 MB/sec execute 595 sec latency 14.756 ms 2024-09-21T07:47:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:38 smithi123 ceph-mon[34166]: pgmap v728: 97 pgs: 97 active+clean; 291 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 286 op/s 2024-09-21T07:47:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:38 smithi060 ceph-mon[31244]: pgmap v728: 97 pgs: 97 active+clean; 291 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 286 op/s 2024-09-21T07:47:38.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:38 smithi187 ceph-mon[34367]: pgmap v728: 97 pgs: 97 active+clean; 291 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 286 op/s 2024-09-21T07:47:39.121 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1797616 13.43 MB/sec execute 596 sec latency 11.038 ms 2024-09-21T07:47:40.121 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1800168 13.43 MB/sec execute 597 sec latency 21.797 ms 2024-09-21T07:47:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:40 smithi123 ceph-mon[34166]: pgmap v729: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:47:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:40 smithi060 ceph-mon[31244]: pgmap v729: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:47:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:40 smithi187 ceph-mon[34367]: pgmap v729: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 3.7 MiB/s wr, 292 op/s 2024-09-21T07:47:41.121 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1802130 13.42 MB/sec execute 598 sec latency 17.544 ms 2024-09-21T07:47:42.121 INFO:tasks.workunit.client.0.smithi060.stdout: 1 1804531 13.43 MB/sec execute 599 sec latency 56.166 ms 2024-09-21T07:47:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:42 smithi123 ceph-mon[34166]: pgmap v730: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:47:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:42 smithi060 ceph-mon[31244]: pgmap v730: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:47:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:42 smithi187 ceph-mon[34367]: pgmap v730: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-09-21T07:47:43.122 INFO:tasks.workunit.client.0.smithi060.stdout: 1 cleanup 600 sec 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: 0 cleanup 600 sec 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: Operation Count AvgLat MaxLat 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: ---------------------------------------- 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: NTCreateX 256641 0.905 230.356 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: Close 188522 0.003 0.096 2024-09-21T07:47:43.271 INFO:tasks.workunit.client.0.smithi060.stdout: Rename 10866 4.249 108.501 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Unlink 51832 1.481 94.659 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Deltree 6 61.889 82.578 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Mkdir 3 0.008 0.012 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Qpathinfo 232626 0.675 248.495 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Qfileinfo 40736 0.001 0.029 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Qfsinfo 42635 0.175 13.447 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Sfileinfo 20912 0.018 2.808 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Find 89897 0.078 62.136 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: WriteX 127837 0.014 27.093 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: ReadX 402065 0.017 104.331 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: LockX 834 0.910 4.132 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: UnlockX 834 0.741 3.363 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: Flush 17983 3.250 245.732 2024-09-21T07:47:43.272 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-21T07:47:43.273 INFO:tasks.workunit.client.0.smithi060.stdout:Throughput 13.4254 MB/sec 1 clients 1 procs max_latency=248.508 ms 2024-09-21T07:47:43.273 INFO:tasks.workunit.client.0.smithi060.stderr:+ dbench 10 2024-09-21T07:47:43.273 INFO:tasks.workunit.client.0.smithi060.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-09-21T07:47:43.273 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-21T07:47:43.273 INFO:tasks.workunit.client.0.smithi060.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-09-21T07:47:43.273 INFO:tasks.workunit.client.0.smithi060.stdout:8 of 10 processes prepared for launch 0 sec 2024-09-21T07:47:43.373 INFO:tasks.workunit.client.0.smithi060.stdout:10 of 10 processes prepared for launch 0 sec 2024-09-21T07:47:43.373 INFO:tasks.workunit.client.0.smithi060.stdout:releasing clients 2024-09-21T07:47:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:44 smithi123 ceph-mon[34166]: pgmap v731: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 248 op/s 2024-09-21T07:47:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:44 smithi060 ceph-mon[31244]: pgmap v731: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 248 op/s 2024-09-21T07:47:44.372 INFO:tasks.workunit.client.0.smithi060.stdout: 10 366 130.97 MB/sec warmup 1 sec latency 53.070 ms 2024-09-21T07:47:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:44 smithi187 ceph-mon[34367]: pgmap v731: 97 pgs: 97 active+clean; 293 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 248 op/s 2024-09-21T07:47:45.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 726 106.24 MB/sec warmup 2 sec latency 191.712 ms 2024-09-21T07:47:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:46 smithi123 ceph-mon[34166]: pgmap v732: 97 pgs: 97 active+clean; 297 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 255 op/s 2024-09-21T07:47:46.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:46 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:47:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:46 smithi060 ceph-mon[31244]: pgmap v732: 97 pgs: 97 active+clean; 297 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 255 op/s 2024-09-21T07:47:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:46 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:47:46.372 INFO:tasks.workunit.client.0.smithi060.stdout: 10 1114 76.54 MB/sec warmup 3 sec latency 120.957 ms 2024-09-21T07:47:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:46 smithi187 ceph-mon[34367]: pgmap v732: 97 pgs: 97 active+clean; 297 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 255 op/s 2024-09-21T07:47:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:46 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:47:47.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 1560 65.28 MB/sec warmup 4 sec latency 100.867 ms 2024-09-21T07:47:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:48 smithi123 ceph-mon[34166]: pgmap v733: 97 pgs: 97 active+clean; 286 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 265 op/s 2024-09-21T07:47:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:48 smithi060 ceph-mon[31244]: pgmap v733: 97 pgs: 97 active+clean; 286 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 265 op/s 2024-09-21T07:47:48.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 2394 56.07 MB/sec warmup 5 sec latency 46.116 ms 2024-09-21T07:47:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:48 smithi187 ceph-mon[34367]: pgmap v733: 97 pgs: 97 active+clean; 286 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 265 op/s 2024-09-21T07:47:49.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 2908 54.80 MB/sec warmup 6 sec latency 76.108 ms 2024-09-21T07:47:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:50 smithi123 ceph-mon[34166]: pgmap v734: 97 pgs: 97 active+clean; 267 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 292 op/s 2024-09-21T07:47:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:50 smithi060 ceph-mon[31244]: pgmap v734: 97 pgs: 97 active+clean; 267 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 292 op/s 2024-09-21T07:47:50.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 3474 52.82 MB/sec warmup 7 sec latency 72.286 ms 2024-09-21T07:47:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:50 smithi187 ceph-mon[34367]: pgmap v734: 97 pgs: 97 active+clean; 267 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.9 MiB/s wr, 292 op/s 2024-09-21T07:47:51.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:51 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:47:51.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:51 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:47:51.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 3824 49.70 MB/sec warmup 8 sec latency 76.456 ms 2024-09-21T07:47:51.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:51 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:47:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:52 smithi123 ceph-mon[34166]: pgmap v735: 97 pgs: 97 active+clean; 266 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 230 op/s 2024-09-21T07:47:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:52 smithi060 ceph-mon[31244]: pgmap v735: 97 pgs: 97 active+clean; 266 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 230 op/s 2024-09-21T07:47:52.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 3964 44.52 MB/sec warmup 9 sec latency 149.622 ms 2024-09-21T07:47:52.420 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:52 smithi187 ceph-mon[34367]: pgmap v735: 97 pgs: 97 active+clean; 266 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 230 op/s 2024-09-21T07:47:53.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 4152 40.15 MB/sec warmup 10 sec latency 123.497 ms 2024-09-21T07:47:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:54 smithi123 ceph-mon[34166]: pgmap v736: 97 pgs: 97 active+clean; 268 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 259 op/s 2024-09-21T07:47:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:54 smithi060 ceph-mon[31244]: pgmap v736: 97 pgs: 97 active+clean; 268 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 259 op/s 2024-09-21T07:47:54.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 4428 37.15 MB/sec warmup 11 sec latency 85.732 ms 2024-09-21T07:47:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:54 smithi187 ceph-mon[34367]: pgmap v736: 97 pgs: 97 active+clean; 268 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 259 op/s 2024-09-21T07:47:55.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 4925 36.40 MB/sec warmup 12 sec latency 87.457 ms 2024-09-21T07:47:56.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:56 smithi123 ceph-mon[34166]: pgmap v737: 97 pgs: 97 active+clean; 275 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 280 op/s 2024-09-21T07:47:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:56 smithi060 ceph-mon[31244]: pgmap v737: 97 pgs: 97 active+clean; 275 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 280 op/s 2024-09-21T07:47:56.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 5655 35.51 MB/sec warmup 13 sec latency 58.570 ms 2024-09-21T07:47:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:56 smithi187 ceph-mon[34367]: pgmap v737: 97 pgs: 97 active+clean; 275 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 280 op/s 2024-09-21T07:47:57.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 6133 34.59 MB/sec warmup 14 sec latency 149.313 ms 2024-09-21T07:47:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:47:58 smithi123 ceph-mon[34166]: pgmap v738: 97 pgs: 97 active+clean; 274 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 4.2 MiB/s wr, 255 op/s 2024-09-21T07:47:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:47:58 smithi060 ceph-mon[31244]: pgmap v738: 97 pgs: 97 active+clean; 274 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 4.2 MiB/s wr, 255 op/s 2024-09-21T07:47:58.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 6774 36.13 MB/sec warmup 15 sec latency 40.575 ms 2024-09-21T07:47:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:47:58 smithi187 ceph-mon[34367]: pgmap v738: 97 pgs: 97 active+clean; 274 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1008 KiB/s rd, 4.2 MiB/s wr, 255 op/s 2024-09-21T07:47:59.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 7271 36.45 MB/sec warmup 16 sec latency 80.344 ms 2024-09-21T07:48:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:00 smithi123 ceph-mon[34166]: pgmap v739: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 310 op/s 2024-09-21T07:48:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:00 smithi060 ceph-mon[31244]: pgmap v739: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 310 op/s 2024-09-21T07:48:00.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 7472 34.74 MB/sec warmup 17 sec latency 75.874 ms 2024-09-21T07:48:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:00 smithi187 ceph-mon[34367]: pgmap v739: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.9 MiB/s wr, 310 op/s 2024-09-21T07:48:01.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 7659 32.92 MB/sec warmup 18 sec latency 122.679 ms 2024-09-21T07:48:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:02 smithi123 ceph-mon[34166]: pgmap v740: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 226 op/s 2024-09-21T07:48:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:02 smithi060 ceph-mon[31244]: pgmap v740: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 226 op/s 2024-09-21T07:48:02.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 7879 31.37 MB/sec warmup 19 sec latency 174.560 ms 2024-09-21T07:48:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:02 smithi187 ceph-mon[34367]: pgmap v740: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.0 MiB/s wr, 226 op/s 2024-09-21T07:48:03.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 8388 31.17 MB/sec warmup 20 sec latency 420.462 ms 2024-09-21T07:48:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:04 smithi123 ceph-mon[34166]: pgmap v741: 97 pgs: 97 active+clean; 284 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 307 op/s 2024-09-21T07:48:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:04 smithi060 ceph-mon[31244]: pgmap v741: 97 pgs: 97 active+clean; 284 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 307 op/s 2024-09-21T07:48:04.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 9124 30.93 MB/sec warmup 21 sec latency 58.663 ms 2024-09-21T07:48:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:04 smithi187 ceph-mon[34367]: pgmap v741: 97 pgs: 97 active+clean; 284 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 307 op/s 2024-09-21T07:48:05.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 9795 31.37 MB/sec warmup 22 sec latency 45.092 ms 2024-09-21T07:48:06.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:06 smithi123 ceph-mon[34166]: pgmap v742: 97 pgs: 97 active+clean; 284 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 290 op/s 2024-09-21T07:48:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:06 smithi060 ceph-mon[31244]: pgmap v742: 97 pgs: 97 active+clean; 284 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 290 op/s 2024-09-21T07:48:06.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 10383 32.25 MB/sec warmup 23 sec latency 87.140 ms 2024-09-21T07:48:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:06 smithi187 ceph-mon[34367]: pgmap v742: 97 pgs: 97 active+clean; 284 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 290 op/s 2024-09-21T07:48:07.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 10729 31.93 MB/sec warmup 24 sec latency 150.097 ms 2024-09-21T07:48:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:08 smithi123 ceph-mon[34166]: pgmap v743: 97 pgs: 97 active+clean; 288 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 296 op/s 2024-09-21T07:48:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:08 smithi060 ceph-mon[31244]: pgmap v743: 97 pgs: 97 active+clean; 288 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 296 op/s 2024-09-21T07:48:08.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 10962 31.22 MB/sec warmup 25 sec latency 80.156 ms 2024-09-21T07:48:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:08 smithi187 ceph-mon[34367]: pgmap v743: 97 pgs: 97 active+clean; 288 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.4 MiB/s wr, 296 op/s 2024-09-21T07:48:09.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 11131 30.11 MB/sec warmup 26 sec latency 153.734 ms 2024-09-21T07:48:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:10 smithi123 ceph-mon[34166]: pgmap v744: 97 pgs: 97 active+clean; 285 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 312 op/s 2024-09-21T07:48:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:10 smithi060 ceph-mon[31244]: pgmap v744: 97 pgs: 97 active+clean; 285 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 312 op/s 2024-09-21T07:48:10.373 INFO:tasks.workunit.client.0.smithi060.stdout: 10 11418 29.27 MB/sec warmup 27 sec latency 72.722 ms 2024-09-21T07:48:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:10 smithi187 ceph-mon[34367]: pgmap v744: 97 pgs: 97 active+clean; 285 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.9 MiB/s wr, 312 op/s 2024-09-21T07:48:11.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 11811 28.93 MB/sec warmup 28 sec latency 63.048 ms 2024-09-21T07:48:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:12 smithi123 ceph-mon[34166]: pgmap v745: 97 pgs: 97 active+clean; 285 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 230 op/s 2024-09-21T07:48:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:12 smithi060 ceph-mon[31244]: pgmap v745: 97 pgs: 97 active+clean; 285 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 230 op/s 2024-09-21T07:48:12.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 12456 28.88 MB/sec warmup 29 sec latency 144.049 ms 2024-09-21T07:48:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:12 smithi187 ceph-mon[34367]: pgmap v745: 97 pgs: 97 active+clean; 285 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 230 op/s 2024-09-21T07:48:13.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 13104 28.83 MB/sec warmup 30 sec latency 88.448 ms 2024-09-21T07:48:14.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:14 smithi123 ceph-mon[34166]: pgmap v746: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 319 op/s 2024-09-21T07:48:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:14 smithi060 ceph-mon[31244]: pgmap v746: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 319 op/s 2024-09-21T07:48:14.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 13687 29.42 MB/sec warmup 31 sec latency 52.389 ms 2024-09-21T07:48:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:14 smithi187 ceph-mon[34367]: pgmap v746: 97 pgs: 97 active+clean; 280 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 319 op/s 2024-09-21T07:48:15.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 14212 29.68 MB/sec warmup 32 sec latency 47.170 ms 2024-09-21T07:48:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:16 smithi123 ceph-mon[34166]: pgmap v747: 97 pgs: 97 active+clean; 277 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-09-21T07:48:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:48:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:16 smithi060 ceph-mon[31244]: pgmap v747: 97 pgs: 97 active+clean; 277 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-09-21T07:48:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:48:16.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 14478 29.34 MB/sec warmup 33 sec latency 106.956 ms 2024-09-21T07:48:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:16 smithi187 ceph-mon[34367]: pgmap v747: 97 pgs: 97 active+clean; 277 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-09-21T07:48:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:48:17.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:48:17.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:48:17.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:48:17.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:48:17.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:48:17.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:48:17.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 14629 28.62 MB/sec warmup 34 sec latency 274.718 ms 2024-09-21T07:48:17.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:48:17.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:48:17.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:48:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:18 smithi123 ceph-mon[34166]: pgmap v748: 97 pgs: 97 active+clean; 282 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 294 op/s 2024-09-21T07:48:18.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:18 smithi060 ceph-mon[31244]: pgmap v748: 97 pgs: 97 active+clean; 282 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 294 op/s 2024-09-21T07:48:18.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 14791 27.89 MB/sec warmup 35 sec latency 527.582 ms 2024-09-21T07:48:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:18 smithi187 ceph-mon[34367]: pgmap v748: 97 pgs: 97 active+clean; 282 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.5 MiB/s wr, 294 op/s 2024-09-21T07:48:19.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 15074 27.33 MB/sec warmup 36 sec latency 69.920 ms 2024-09-21T07:48:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:20 smithi123 ceph-mon[34166]: pgmap v749: 97 pgs: 97 active+clean; 367 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 291 op/s 2024-09-21T07:48:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:20 smithi060 ceph-mon[31244]: pgmap v749: 97 pgs: 97 active+clean; 367 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 291 op/s 2024-09-21T07:48:20.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 15483 27.08 MB/sec warmup 37 sec latency 69.723 ms 2024-09-21T07:48:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:20 smithi187 ceph-mon[34367]: pgmap v749: 97 pgs: 97 active+clean; 367 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 11 MiB/s wr, 291 op/s 2024-09-21T07:48:21.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 16061 26.95 MB/sec warmup 38 sec latency 46.352 ms 2024-09-21T07:48:22.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:22 smithi123 ceph-mon[34166]: pgmap v750: 97 pgs: 97 active+clean; 385 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 11 MiB/s wr, 244 op/s 2024-09-21T07:48:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:22 smithi060 ceph-mon[31244]: pgmap v750: 97 pgs: 97 active+clean; 385 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 11 MiB/s wr, 244 op/s 2024-09-21T07:48:22.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 16646 27.21 MB/sec warmup 39 sec latency 108.688 ms 2024-09-21T07:48:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:22 smithi187 ceph-mon[34367]: pgmap v750: 97 pgs: 97 active+clean; 385 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 11 MiB/s wr, 244 op/s 2024-09-21T07:48:23.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 17158 27.41 MB/sec warmup 40 sec latency 253.954 ms 2024-09-21T07:48:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:24 smithi123 ceph-mon[34166]: pgmap v751: 97 pgs: 97 active+clean; 473 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 19 MiB/s wr, 352 op/s 2024-09-21T07:48:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:24 smithi060 ceph-mon[31244]: pgmap v751: 97 pgs: 97 active+clean; 473 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 19 MiB/s wr, 352 op/s 2024-09-21T07:48:24.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 17514 27.45 MB/sec warmup 41 sec latency 117.851 ms 2024-09-21T07:48:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:24 smithi187 ceph-mon[34367]: pgmap v751: 97 pgs: 97 active+clean; 473 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 19 MiB/s wr, 352 op/s 2024-09-21T07:48:25.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 17866 27.32 MB/sec warmup 42 sec latency 69.676 ms 2024-09-21T07:48:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:26 smithi060 ceph-mon[31244]: pgmap v752: 97 pgs: 97 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 19 MiB/s wr, 275 op/s 2024-09-21T07:48:26.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 18090 26.97 MB/sec warmup 43 sec latency 88.507 ms 2024-09-21T07:48:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:26 smithi187 ceph-mon[34367]: pgmap v752: 97 pgs: 97 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 19 MiB/s wr, 275 op/s 2024-09-21T07:48:26.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:26 smithi123 ceph-mon[34166]: pgmap v752: 97 pgs: 97 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 19 MiB/s wr, 275 op/s 2024-09-21T07:48:27.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 18337 26.54 MB/sec warmup 44 sec latency 62.139 ms 2024-09-21T07:48:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:28 smithi060 ceph-mon[31244]: pgmap v753: 97 pgs: 97 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 20 MiB/s wr, 328 op/s 2024-09-21T07:48:28.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 18520 26.09 MB/sec warmup 45 sec latency 207.327 ms 2024-09-21T07:48:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:28 smithi187 ceph-mon[34367]: pgmap v753: 97 pgs: 97 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 20 MiB/s wr, 328 op/s 2024-09-21T07:48:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:28 smithi123 ceph-mon[34166]: pgmap v753: 97 pgs: 97 active+clean; 482 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 20 MiB/s wr, 328 op/s 2024-09-21T07:48:29.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 18834 25.85 MB/sec warmup 46 sec latency 100.050 ms 2024-09-21T07:48:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:30 smithi060 ceph-mon[31244]: pgmap v754: 97 pgs: 97 active+clean; 455 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 20 MiB/s wr, 351 op/s 2024-09-21T07:48:30.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 19442 25.77 MB/sec warmup 47 sec latency 58.041 ms 2024-09-21T07:48:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:30 smithi187 ceph-mon[34367]: pgmap v754: 97 pgs: 97 active+clean; 455 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 20 MiB/s wr, 351 op/s 2024-09-21T07:48:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:30 smithi123 ceph-mon[34166]: pgmap v754: 97 pgs: 97 active+clean; 455 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 20 MiB/s wr, 351 op/s 2024-09-21T07:48:31.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 20064 25.99 MB/sec warmup 48 sec latency 41.956 ms 2024-09-21T07:48:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:32 smithi060 ceph-mon[31244]: pgmap v755: 97 pgs: 97 active+clean; 455 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 305 op/s 2024-09-21T07:48:32.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 20733 26.25 MB/sec warmup 49 sec latency 41.348 ms 2024-09-21T07:48:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:32 smithi187 ceph-mon[34367]: pgmap v755: 97 pgs: 97 active+clean; 455 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 305 op/s 2024-09-21T07:48:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:32 smithi123 ceph-mon[34166]: pgmap v755: 97 pgs: 97 active+clean; 455 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 305 op/s 2024-09-21T07:48:33.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 21105 26.39 MB/sec warmup 50 sec latency 108.323 ms 2024-09-21T07:48:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:34 smithi060 ceph-mon[31244]: pgmap v756: 97 pgs: 97 active+clean; 459 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 376 op/s 2024-09-21T07:48:34.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 21417 26.20 MB/sec warmup 51 sec latency 91.745 ms 2024-09-21T07:48:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:34 smithi187 ceph-mon[34367]: pgmap v756: 97 pgs: 97 active+clean; 459 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 376 op/s 2024-09-21T07:48:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:34 smithi123 ceph-mon[34166]: pgmap v756: 97 pgs: 97 active+clean; 459 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 376 op/s 2024-09-21T07:48:35.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 21664 26.00 MB/sec warmup 52 sec latency 64.737 ms 2024-09-21T07:48:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:36 smithi060 ceph-mon[31244]: pgmap v757: 97 pgs: 97 active+clean; 466 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-09-21T07:48:36.374 INFO:tasks.workunit.client.0.smithi060.stdout: 10 21881 25.62 MB/sec warmup 53 sec latency 96.784 ms 2024-09-21T07:48:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:36 smithi187 ceph-mon[34367]: pgmap v757: 97 pgs: 97 active+clean; 466 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-09-21T07:48:36.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:36 smithi123 ceph-mon[34166]: pgmap v757: 97 pgs: 97 active+clean; 466 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-09-21T07:48:37.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 22227 25.41 MB/sec warmup 54 sec latency 69.988 ms 2024-09-21T07:48:38.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:37 smithi187 ceph-mon[34367]: pgmap v758: 97 pgs: 97 active+clean; 469 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 347 op/s 2024-09-21T07:48:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:37 smithi123 ceph-mon[34166]: pgmap v758: 97 pgs: 97 active+clean; 469 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 347 op/s 2024-09-21T07:48:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:37 smithi060 ceph-mon[31244]: pgmap v758: 97 pgs: 97 active+clean; 469 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 347 op/s 2024-09-21T07:48:38.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 22424 25.13 MB/sec warmup 55 sec latency 338.965 ms 2024-09-21T07:48:39.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 22984 24.98 MB/sec warmup 56 sec latency 150.353 ms 2024-09-21T07:48:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:39 smithi187 ceph-mon[34367]: pgmap v759: 97 pgs: 97 active+clean; 476 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 363 op/s 2024-09-21T07:48:40.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:39 smithi123 ceph-mon[34166]: pgmap v759: 97 pgs: 97 active+clean; 476 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 363 op/s 2024-09-21T07:48:40.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:39 smithi060 ceph-mon[31244]: pgmap v759: 97 pgs: 97 active+clean; 476 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 363 op/s 2024-09-21T07:48:40.411 INFO:tasks.workunit.client.0.smithi060.stdout: 10 23529 25.18 MB/sec warmup 57 sec latency 88.042 ms 2024-09-21T07:48:41.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 24216 25.34 MB/sec warmup 58 sec latency 66.481 ms 2024-09-21T07:48:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:41 smithi187 ceph-mon[34367]: pgmap v760: 97 pgs: 97 active+clean; 476 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 290 op/s 2024-09-21T07:48:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:41 smithi123 ceph-mon[34166]: pgmap v760: 97 pgs: 97 active+clean; 476 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 290 op/s 2024-09-21T07:48:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:41 smithi060 ceph-mon[31244]: pgmap v760: 97 pgs: 97 active+clean; 476 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 290 op/s 2024-09-21T07:48:42.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 24625 25.54 MB/sec warmup 59 sec latency 46.857 ms 2024-09-21T07:48:43.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 24926 25.46 MB/sec warmup 60 sec latency 142.734 ms 2024-09-21T07:48:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:43 smithi187 ceph-mon[34367]: pgmap v761: 97 pgs: 97 active+clean; 475 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 6.7 MiB/s wr, 356 op/s 2024-09-21T07:48:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:43 smithi123 ceph-mon[34166]: pgmap v761: 97 pgs: 97 active+clean; 475 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 6.7 MiB/s wr, 356 op/s 2024-09-21T07:48:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:43 smithi060 ceph-mon[31244]: pgmap v761: 97 pgs: 97 active+clean; 475 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 6.7 MiB/s wr, 356 op/s 2024-09-21T07:48:44.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 25167 25.29 MB/sec warmup 61 sec latency 108.321 ms 2024-09-21T07:48:45.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 25362 24.97 MB/sec warmup 62 sec latency 124.354 ms 2024-09-21T07:48:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:45 smithi187 ceph-mon[34367]: pgmap v762: 97 pgs: 97 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 355 op/s 2024-09-21T07:48:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:45 smithi123 ceph-mon[34166]: pgmap v762: 97 pgs: 97 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 355 op/s 2024-09-21T07:48:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:45 smithi060 ceph-mon[31244]: pgmap v762: 97 pgs: 97 active+clean; 474 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 355 op/s 2024-09-21T07:48:46.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 25613 24.67 MB/sec warmup 63 sec latency 106.462 ms 2024-09-21T07:48:47.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 25971 24.59 MB/sec warmup 64 sec latency 94.664 ms 2024-09-21T07:48:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:47 smithi187 ceph-mon[34367]: pgmap v763: 97 pgs: 97 active+clean; 453 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 352 op/s 2024-09-21T07:48:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:47 smithi123 ceph-mon[34166]: pgmap v763: 97 pgs: 97 active+clean; 453 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 352 op/s 2024-09-21T07:48:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:47 smithi060 ceph-mon[31244]: pgmap v763: 97 pgs: 97 active+clean; 453 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 352 op/s 2024-09-21T07:48:48.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 26258 24.36 MB/sec warmup 65 sec latency 294.274 ms 2024-09-21T07:48:49.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 26750 24.25 MB/sec warmup 66 sec latency 91.570 ms 2024-09-21T07:48:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:49 smithi187 ceph-mon[34367]: pgmap v764: 97 pgs: 97 active+clean; 462 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.3 MiB/s wr, 385 op/s 2024-09-21T07:48:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:49 smithi123 ceph-mon[34166]: pgmap v764: 97 pgs: 97 active+clean; 462 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.3 MiB/s wr, 385 op/s 2024-09-21T07:48:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:49 smithi060 ceph-mon[31244]: pgmap v764: 97 pgs: 97 active+clean; 462 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.3 MiB/s wr, 385 op/s 2024-09-21T07:48:50.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 27312 24.43 MB/sec warmup 67 sec latency 43.196 ms 2024-09-21T07:48:51.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 27923 24.63 MB/sec warmup 68 sec latency 77.008 ms 2024-09-21T07:48:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:51 smithi187 ceph-mon[34367]: pgmap v765: 97 pgs: 97 active+clean; 463 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:48:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:51 smithi123 ceph-mon[34166]: pgmap v765: 97 pgs: 97 active+clean; 463 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:48:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:51 smithi060 ceph-mon[31244]: pgmap v765: 97 pgs: 97 active+clean; 463 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:48:52.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 28320 24.78 MB/sec warmup 69 sec latency 77.936 ms 2024-09-21T07:48:53.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 28548 24.60 MB/sec warmup 70 sec latency 343.693 ms 2024-09-21T07:48:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:53 smithi187 ceph-mon[34367]: pgmap v766: 97 pgs: 97 active+clean; 480 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.9 MiB/s wr, 407 op/s 2024-09-21T07:48:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:53 smithi123 ceph-mon[34166]: pgmap v766: 97 pgs: 97 active+clean; 480 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.9 MiB/s wr, 407 op/s 2024-09-21T07:48:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:53 smithi060 ceph-mon[31244]: pgmap v766: 97 pgs: 97 active+clean; 480 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 7.9 MiB/s wr, 407 op/s 2024-09-21T07:48:54.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 28783 24.44 MB/sec warmup 71 sec latency 136.939 ms 2024-09-21T07:48:55.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 28998 24.20 MB/sec warmup 72 sec latency 111.268 ms 2024-09-21T07:48:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:55 smithi187 ceph-mon[34367]: pgmap v767: 97 pgs: 97 active+clean; 478 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 7.0 MiB/s wr, 376 op/s 2024-09-21T07:48:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:55 smithi123 ceph-mon[34166]: pgmap v767: 97 pgs: 97 active+clean; 478 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 7.0 MiB/s wr, 376 op/s 2024-09-21T07:48:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:55 smithi060 ceph-mon[31244]: pgmap v767: 97 pgs: 97 active+clean; 478 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 7.0 MiB/s wr, 376 op/s 2024-09-21T07:48:56.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 29307 24.01 MB/sec warmup 73 sec latency 58.322 ms 2024-09-21T07:48:57.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 29754 23.91 MB/sec warmup 74 sec latency 76.828 ms 2024-09-21T07:48:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:57 smithi187 ceph-mon[34367]: pgmap v768: 97 pgs: 97 active+clean; 478 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 7.2 MiB/s wr, 351 op/s 2024-09-21T07:48:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:57 smithi123 ceph-mon[34166]: pgmap v768: 97 pgs: 97 active+clean; 478 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 7.2 MiB/s wr, 351 op/s 2024-09-21T07:48:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:57 smithi060 ceph-mon[31244]: pgmap v768: 97 pgs: 97 active+clean; 478 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 7.2 MiB/s wr, 351 op/s 2024-09-21T07:48:58.375 INFO:tasks.workunit.client.0.smithi060.stdout: 10 30214 23.90 MB/sec warmup 75 sec latency 131.060 ms 2024-09-21T07:48:59.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 30779 24.04 MB/sec warmup 76 sec latency 82.561 ms 2024-09-21T07:49:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:48:59 smithi187 ceph-mon[34367]: pgmap v769: 97 pgs: 97 active+clean; 484 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 8.4 MiB/s wr, 421 op/s 2024-09-21T07:49:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:48:59 smithi123 ceph-mon[34166]: pgmap v769: 97 pgs: 97 active+clean; 484 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 8.4 MiB/s wr, 421 op/s 2024-09-21T07:49:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:48:59 smithi060 ceph-mon[31244]: pgmap v769: 97 pgs: 97 active+clean; 484 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 8.4 MiB/s wr, 421 op/s 2024-09-21T07:49:00.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 31359 24.15 MB/sec warmup 77 sec latency 108.038 ms 2024-09-21T07:49:01.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 31792 24.30 MB/sec warmup 78 sec latency 58.589 ms 2024-09-21T07:49:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:01 smithi187 ceph-mon[34367]: pgmap v770: 97 pgs: 97 active+clean; 480 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.7 MiB/s wr, 342 op/s 2024-09-21T07:49:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:01 smithi123 ceph-mon[34166]: pgmap v770: 97 pgs: 97 active+clean; 480 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.7 MiB/s wr, 342 op/s 2024-09-21T07:49:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:01 smithi060 ceph-mon[31244]: pgmap v770: 97 pgs: 97 active+clean; 480 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.7 MiB/s wr, 342 op/s 2024-09-21T07:49:02.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 32103 24.22 MB/sec warmup 79 sec latency 50.676 ms 2024-09-21T07:49:03.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 32326 24.08 MB/sec warmup 80 sec latency 186.701 ms 2024-09-21T07:49:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:03 smithi187 ceph-mon[34367]: pgmap v771: 97 pgs: 97 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.6 MiB/s wr, 387 op/s 2024-09-21T07:49:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:03 smithi123 ceph-mon[34166]: pgmap v771: 97 pgs: 97 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.6 MiB/s wr, 387 op/s 2024-09-21T07:49:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:03 smithi060 ceph-mon[31244]: pgmap v771: 97 pgs: 97 active+clean; 473 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 7.6 MiB/s wr, 387 op/s 2024-09-21T07:49:04.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 32524 23.86 MB/sec warmup 81 sec latency 228.432 ms 2024-09-21T07:49:05.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 32804 23.69 MB/sec warmup 82 sec latency 155.370 ms 2024-09-21T07:49:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:05 smithi187 ceph-mon[34367]: pgmap v772: 97 pgs: 97 active+clean; 465 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-09-21T07:49:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:05 smithi123 ceph-mon[34166]: pgmap v772: 97 pgs: 97 active+clean; 465 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-09-21T07:49:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:05 smithi060 ceph-mon[31244]: pgmap v772: 97 pgs: 97 active+clean; 465 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-09-21T07:49:06.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 33240 23.60 MB/sec warmup 83 sec latency 62.064 ms 2024-09-21T07:49:07.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 33769 23.54 MB/sec warmup 84 sec latency 104.086 ms 2024-09-21T07:49:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:07 smithi187 ceph-mon[34367]: pgmap v773: 97 pgs: 97 active+clean; 468 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.6 MiB/s wr, 372 op/s 2024-09-21T07:49:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:07 smithi123 ceph-mon[34166]: pgmap v773: 97 pgs: 97 active+clean; 468 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.6 MiB/s wr, 372 op/s 2024-09-21T07:49:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:07 smithi060 ceph-mon[31244]: pgmap v773: 97 pgs: 97 active+clean; 468 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.6 MiB/s wr, 372 op/s 2024-09-21T07:49:08.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 34357 23.75 MB/sec warmup 85 sec latency 63.539 ms 2024-09-21T07:49:09.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 34920 23.84 MB/sec warmup 86 sec latency 112.079 ms 2024-09-21T07:49:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:09 smithi187 ceph-mon[34367]: pgmap v774: 97 pgs: 97 active+clean; 469 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.1 MiB/s wr, 399 op/s 2024-09-21T07:49:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:09 smithi123 ceph-mon[34166]: pgmap v774: 97 pgs: 97 active+clean; 469 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.1 MiB/s wr, 399 op/s 2024-09-21T07:49:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:09 smithi060 ceph-mon[31244]: pgmap v774: 97 pgs: 97 active+clean; 469 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.1 MiB/s wr, 399 op/s 2024-09-21T07:49:10.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 35300 23.91 MB/sec warmup 87 sec latency 67.616 ms 2024-09-21T07:49:11.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 35622 23.88 MB/sec warmup 88 sec latency 72.050 ms 2024-09-21T07:49:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:11 smithi187 ceph-mon[34367]: pgmap v775: 97 pgs: 97 active+clean; 470 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.6 MiB/s wr, 296 op/s 2024-09-21T07:49:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:11 smithi123 ceph-mon[34166]: pgmap v775: 97 pgs: 97 active+clean; 470 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.6 MiB/s wr, 296 op/s 2024-09-21T07:49:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:11 smithi060 ceph-mon[31244]: pgmap v775: 97 pgs: 97 active+clean; 470 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 4.6 MiB/s wr, 296 op/s 2024-09-21T07:49:12.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 35903 23.80 MB/sec warmup 89 sec latency 69.630 ms 2024-09-21T07:49:13.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 36163 23.63 MB/sec warmup 90 sec latency 56.582 ms 2024-09-21T07:49:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:13 smithi187 ceph-mon[34367]: pgmap v776: 97 pgs: 97 active+clean; 472 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.4 MiB/s wr, 340 op/s 2024-09-21T07:49:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:13 smithi123 ceph-mon[34166]: pgmap v776: 97 pgs: 97 active+clean; 472 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.4 MiB/s wr, 340 op/s 2024-09-21T07:49:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:13 smithi060 ceph-mon[31244]: pgmap v776: 97 pgs: 97 active+clean; 472 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.4 MiB/s wr, 340 op/s 2024-09-21T07:49:14.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 36403 23.49 MB/sec warmup 91 sec latency 324.074 ms 2024-09-21T07:49:15.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 36797 23.37 MB/sec warmup 92 sec latency 90.490 ms 2024-09-21T07:49:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:15 smithi187 ceph-mon[34367]: pgmap v777: 97 pgs: 97 active+clean; 478 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.9 MiB/s wr, 350 op/s 2024-09-21T07:49:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:15 smithi123 ceph-mon[34166]: pgmap v777: 97 pgs: 97 active+clean; 478 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.9 MiB/s wr, 350 op/s 2024-09-21T07:49:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:15 smithi060 ceph-mon[31244]: pgmap v777: 97 pgs: 97 active+clean; 478 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 4.9 MiB/s wr, 350 op/s 2024-09-21T07:49:16.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 37284 23.33 MB/sec warmup 93 sec latency 76.599 ms 2024-09-21T07:49:17.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:16 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:49:17.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:16 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:49:17.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:16 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:49:17.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 37845 23.43 MB/sec warmup 94 sec latency 122.274 ms 2024-09-21T07:49:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:17 smithi187 ceph-mon[34367]: pgmap v778: 97 pgs: 97 active+clean; 480 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 366 op/s 2024-09-21T07:49:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:49:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:49:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:49:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:17 smithi123 ceph-mon[34166]: pgmap v778: 97 pgs: 97 active+clean; 480 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 366 op/s 2024-09-21T07:49:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:49:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:49:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:49:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:17 smithi060 ceph-mon[31244]: pgmap v778: 97 pgs: 97 active+clean; 480 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 366 op/s 2024-09-21T07:49:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:49:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:49:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:49:18.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 38445 23.60 MB/sec warmup 95 sec latency 42.581 ms 2024-09-21T07:49:19.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 38760 23.61 MB/sec warmup 96 sec latency 175.110 ms 2024-09-21T07:49:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:19 smithi187 ceph-mon[34367]: pgmap v779: 97 pgs: 97 active+clean; 483 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.1 MiB/s wr, 359 op/s 2024-09-21T07:49:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:19 smithi123 ceph-mon[34166]: pgmap v779: 97 pgs: 97 active+clean; 483 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.1 MiB/s wr, 359 op/s 2024-09-21T07:49:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:19 smithi060 ceph-mon[31244]: pgmap v779: 97 pgs: 97 active+clean; 483 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 6.1 MiB/s wr, 359 op/s 2024-09-21T07:49:20.376 INFO:tasks.workunit.client.0.smithi060.stdout: 10 39061 23.61 MB/sec warmup 97 sec latency 87.546 ms 2024-09-21T07:49:21.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 39335 23.52 MB/sec warmup 98 sec latency 68.345 ms 2024-09-21T07:49:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:21 smithi187 ceph-mon[34367]: pgmap v780: 97 pgs: 97 active+clean; 482 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 289 op/s 2024-09-21T07:49:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:21 smithi123 ceph-mon[34166]: pgmap v780: 97 pgs: 97 active+clean; 482 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 289 op/s 2024-09-21T07:49:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:21 smithi060 ceph-mon[31244]: pgmap v780: 97 pgs: 97 active+clean; 482 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 289 op/s 2024-09-21T07:49:22.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 39586 23.36 MB/sec warmup 99 sec latency 121.408 ms 2024-09-21T07:49:23.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 39916 23.28 MB/sec warmup 100 sec latency 71.115 ms 2024-09-21T07:49:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:23 smithi187 ceph-mon[34367]: pgmap v781: 97 pgs: 97 active+clean; 480 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 365 op/s 2024-09-21T07:49:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:23 smithi123 ceph-mon[34166]: pgmap v781: 97 pgs: 97 active+clean; 480 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 365 op/s 2024-09-21T07:49:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:23 smithi060 ceph-mon[31244]: pgmap v781: 97 pgs: 97 active+clean; 480 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 365 op/s 2024-09-21T07:49:24.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 40202 23.13 MB/sec warmup 101 sec latency 293.999 ms 2024-09-21T07:49:25.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 40600 23.07 MB/sec warmup 102 sec latency 185.278 ms 2024-09-21T07:49:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:25 smithi187 ceph-mon[34367]: pgmap v782: 97 pgs: 97 active+clean; 466 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 347 op/s 2024-09-21T07:49:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:25 smithi123 ceph-mon[34166]: pgmap v782: 97 pgs: 97 active+clean; 466 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 347 op/s 2024-09-21T07:49:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:25 smithi060 ceph-mon[31244]: pgmap v782: 97 pgs: 97 active+clean; 466 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 347 op/s 2024-09-21T07:49:26.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 41149 23.11 MB/sec warmup 103 sec latency 89.559 ms 2024-09-21T07:49:27.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 41715 23.28 MB/sec warmup 104 sec latency 52.394 ms 2024-09-21T07:49:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:27 smithi187 ceph-mon[34367]: pgmap v783: 97 pgs: 97 active+clean; 467 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 336 op/s 2024-09-21T07:49:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:27 smithi123 ceph-mon[34166]: pgmap v783: 97 pgs: 97 active+clean; 467 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 336 op/s 2024-09-21T07:49:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:27 smithi060 ceph-mon[31244]: pgmap v783: 97 pgs: 97 active+clean; 467 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 336 op/s 2024-09-21T07:49:28.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 42265 23.34 MB/sec warmup 105 sec latency 58.538 ms 2024-09-21T07:49:29.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 42537 23.37 MB/sec warmup 106 sec latency 239.268 ms 2024-09-21T07:49:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:29 smithi187 ceph-mon[34367]: pgmap v784: 97 pgs: 97 active+clean; 473 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 353 op/s 2024-09-21T07:49:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:29 smithi123 ceph-mon[34166]: pgmap v784: 97 pgs: 97 active+clean; 473 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 353 op/s 2024-09-21T07:49:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:29 smithi060 ceph-mon[31244]: pgmap v784: 97 pgs: 97 active+clean; 473 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 353 op/s 2024-09-21T07:49:30.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 42799 23.26 MB/sec warmup 107 sec latency 88.450 ms 2024-09-21T07:49:31.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 43043 23.16 MB/sec warmup 108 sec latency 68.811 ms 2024-09-21T07:49:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:31 smithi187 ceph-mon[34367]: pgmap v785: 97 pgs: 97 active+clean; 473 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.1 MiB/s wr, 293 op/s 2024-09-21T07:49:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:31 smithi123 ceph-mon[34166]: pgmap v785: 97 pgs: 97 active+clean; 473 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.1 MiB/s wr, 293 op/s 2024-09-21T07:49:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:31 smithi060 ceph-mon[31244]: pgmap v785: 97 pgs: 97 active+clean; 473 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.1 MiB/s wr, 293 op/s 2024-09-21T07:49:32.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 43319 23.03 MB/sec warmup 109 sec latency 92.825 ms 2024-09-21T07:49:33.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 43729 22.98 MB/sec warmup 110 sec latency 53.733 ms 2024-09-21T07:49:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:33 smithi187 ceph-mon[34367]: pgmap v786: 97 pgs: 97 active+clean; 478 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.3 MiB/s wr, 386 op/s 2024-09-21T07:49:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:33 smithi123 ceph-mon[34166]: pgmap v786: 97 pgs: 97 active+clean; 478 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.3 MiB/s wr, 386 op/s 2024-09-21T07:49:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:33 smithi060 ceph-mon[31244]: pgmap v786: 97 pgs: 97 active+clean; 478 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.3 MiB/s wr, 386 op/s 2024-09-21T07:49:34.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 44072 22.90 MB/sec warmup 111 sec latency 204.139 ms 2024-09-21T07:49:35.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 44588 22.90 MB/sec warmup 112 sec latency 83.116 ms 2024-09-21T07:49:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:35 smithi187 ceph-mon[34367]: pgmap v787: 97 pgs: 97 active+clean; 478 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.7 MiB/s wr, 324 op/s 2024-09-21T07:49:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:35 smithi123 ceph-mon[34166]: pgmap v787: 97 pgs: 97 active+clean; 478 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.7 MiB/s wr, 324 op/s 2024-09-21T07:49:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:35 smithi060 ceph-mon[31244]: pgmap v787: 97 pgs: 97 active+clean; 478 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.7 MiB/s wr, 324 op/s 2024-09-21T07:49:36.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 45075 23.03 MB/sec warmup 113 sec latency 107.849 ms 2024-09-21T07:49:37.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 45651 23.09 MB/sec warmup 114 sec latency 63.279 ms 2024-09-21T07:49:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:37 smithi187 ceph-mon[34367]: pgmap v788: 97 pgs: 97 active+clean; 483 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.5 MiB/s wr, 367 op/s 2024-09-21T07:49:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:37 smithi123 ceph-mon[34166]: pgmap v788: 97 pgs: 97 active+clean; 483 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.5 MiB/s wr, 367 op/s 2024-09-21T07:49:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:37 smithi060 ceph-mon[31244]: pgmap v788: 97 pgs: 97 active+clean; 483 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.5 MiB/s wr, 367 op/s 2024-09-21T07:49:38.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 46020 23.15 MB/sec warmup 115 sec latency 64.649 ms 2024-09-21T07:49:39.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 46193 23.05 MB/sec warmup 116 sec latency 259.615 ms 2024-09-21T07:49:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:39 smithi187 ceph-mon[34367]: pgmap v789: 97 pgs: 97 active+clean; 486 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.7 MiB/s wr, 370 op/s 2024-09-21T07:49:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:39 smithi123 ceph-mon[34166]: pgmap v789: 97 pgs: 97 active+clean; 486 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.7 MiB/s wr, 370 op/s 2024-09-21T07:49:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:39 smithi060 ceph-mon[31244]: pgmap v789: 97 pgs: 97 active+clean; 486 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.7 MiB/s wr, 370 op/s 2024-09-21T07:49:40.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 46466 22.98 MB/sec warmup 117 sec latency 135.378 ms 2024-09-21T07:49:41.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 46724 22.87 MB/sec warmup 118 sec latency 81.917 ms 2024-09-21T07:49:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:41 smithi187 ceph-mon[34367]: pgmap v790: 97 pgs: 97 active+clean; 485 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 287 op/s 2024-09-21T07:49:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:41 smithi123 ceph-mon[34166]: pgmap v790: 97 pgs: 97 active+clean; 485 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 287 op/s 2024-09-21T07:49:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:41 smithi060 ceph-mon[31244]: pgmap v790: 97 pgs: 97 active+clean; 485 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 287 op/s 2024-09-21T07:49:42.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 47048 22.78 MB/sec warmup 119 sec latency 68.123 ms 2024-09-21T07:49:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:43 smithi187 ceph-mon[34367]: pgmap v791: 97 pgs: 97 active+clean; 460 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 352 op/s 2024-09-21T07:49:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:43 smithi123 ceph-mon[34166]: pgmap v791: 97 pgs: 97 active+clean; 460 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 352 op/s 2024-09-21T07:49:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:43 smithi060 ceph-mon[31244]: pgmap v791: 97 pgs: 97 active+clean; 460 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 352 op/s 2024-09-21T07:49:44.377 INFO:tasks.workunit.client.0.smithi060.stdout: 10 47928 24.59 MB/sec execute 1 sec latency 104.288 ms 2024-09-21T07:49:45.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 48428 21.97 MB/sec execute 2 sec latency 62.129 ms 2024-09-21T07:49:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:45 smithi187 ceph-mon[34367]: pgmap v792: 97 pgs: 97 active+clean; 466 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 326 op/s 2024-09-21T07:49:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:45 smithi123 ceph-mon[34166]: pgmap v792: 97 pgs: 97 active+clean; 466 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 326 op/s 2024-09-21T07:49:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:45 smithi060 ceph-mon[31244]: pgmap v792: 97 pgs: 97 active+clean; 466 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 326 op/s 2024-09-21T07:49:46.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 48917 26.33 MB/sec execute 3 sec latency 112.121 ms 2024-09-21T07:49:47.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 49389 27.59 MB/sec execute 4 sec latency 52.802 ms 2024-09-21T07:49:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:47 smithi187 ceph-mon[34367]: pgmap v793: 97 pgs: 97 active+clean; 467 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 344 op/s 2024-09-21T07:49:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:47 smithi123 ceph-mon[34166]: pgmap v793: 97 pgs: 97 active+clean; 467 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 344 op/s 2024-09-21T07:49:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:47 smithi060 ceph-mon[31244]: pgmap v793: 97 pgs: 97 active+clean; 467 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 344 op/s 2024-09-21T07:49:48.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 49731 27.45 MB/sec execute 5 sec latency 44.524 ms 2024-09-21T07:49:49.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 50008 25.39 MB/sec execute 6 sec latency 106.435 ms 2024-09-21T07:49:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:49 smithi187 ceph-mon[34367]: pgmap v794: 97 pgs: 97 active+clean; 475 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-21T07:49:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:49 smithi123 ceph-mon[34166]: pgmap v794: 97 pgs: 97 active+clean; 475 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-21T07:49:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:49 smithi060 ceph-mon[31244]: pgmap v794: 97 pgs: 97 active+clean; 475 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 351 op/s 2024-09-21T07:49:50.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 50213 22.94 MB/sec execute 7 sec latency 278.567 ms 2024-09-21T07:49:51.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 50472 21.32 MB/sec execute 8 sec latency 160.874 ms 2024-09-21T07:49:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:51 smithi187 ceph-mon[34367]: pgmap v795: 97 pgs: 97 active+clean; 476 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 305 op/s 2024-09-21T07:49:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:51 smithi123 ceph-mon[34166]: pgmap v795: 97 pgs: 97 active+clean; 476 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 305 op/s 2024-09-21T07:49:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:51 smithi060 ceph-mon[31244]: pgmap v795: 97 pgs: 97 active+clean; 476 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 305 op/s 2024-09-21T07:49:52.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 50943 20.90 MB/sec execute 9 sec latency 71.653 ms 2024-09-21T07:49:53.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 51325 20.22 MB/sec execute 10 sec latency 97.804 ms 2024-09-21T07:49:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:53 smithi187 ceph-mon[34367]: pgmap v796: 97 pgs: 97 active+clean; 476 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-09-21T07:49:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:53 smithi123 ceph-mon[34166]: pgmap v796: 97 pgs: 97 active+clean; 476 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-09-21T07:49:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:53 smithi060 ceph-mon[31244]: pgmap v796: 97 pgs: 97 active+clean; 476 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-09-21T07:49:54.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 51879 21.17 MB/sec execute 11 sec latency 49.134 ms 2024-09-21T07:49:55.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 52367 22.65 MB/sec execute 12 sec latency 154.897 ms 2024-09-21T07:49:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:55 smithi187 ceph-mon[34367]: pgmap v797: 97 pgs: 97 active+clean; 479 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-09-21T07:49:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:55 smithi123 ceph-mon[34166]: pgmap v797: 97 pgs: 97 active+clean; 479 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-09-21T07:49:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:55 smithi060 ceph-mon[31244]: pgmap v797: 97 pgs: 97 active+clean; 479 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-09-21T07:49:56.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 52888 23.06 MB/sec execute 13 sec latency 74.207 ms 2024-09-21T07:49:57.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 53190 23.05 MB/sec execute 14 sec latency 68.127 ms 2024-09-21T07:49:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:57 smithi187 ceph-mon[34367]: pgmap v798: 97 pgs: 97 active+clean; 485 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 364 op/s 2024-09-21T07:49:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:57 smithi123 ceph-mon[34166]: pgmap v798: 97 pgs: 97 active+clean; 485 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 364 op/s 2024-09-21T07:49:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:57 smithi060 ceph-mon[31244]: pgmap v798: 97 pgs: 97 active+clean; 485 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 364 op/s 2024-09-21T07:49:58.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 53492 22.58 MB/sec execute 15 sec latency 62.688 ms 2024-09-21T07:49:59.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 53761 21.98 MB/sec execute 16 sec latency 181.174 ms 2024-09-21T07:50:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:49:59 smithi187 ceph-mon[34367]: pgmap v799: 97 pgs: 97 active+clean; 485 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 354 op/s 2024-09-21T07:50:00.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:49:59 smithi123 ceph-mon[34166]: pgmap v799: 97 pgs: 97 active+clean; 485 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 354 op/s 2024-09-21T07:50:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:49:59 smithi060 ceph-mon[31244]: pgmap v799: 97 pgs: 97 active+clean; 485 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 354 op/s 2024-09-21T07:50:00.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 53971 21.22 MB/sec execute 17 sec latency 273.855 ms 2024-09-21T07:50:01.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:01 smithi187 ceph-mon[34367]: overall HEALTH_OK 2024-09-21T07:50:01.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:01 smithi123 ceph-mon[34166]: overall HEALTH_OK 2024-09-21T07:50:01.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:01 smithi060 ceph-mon[31244]: overall HEALTH_OK 2024-09-21T07:50:01.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 54314 20.77 MB/sec execute 18 sec latency 70.956 ms 2024-09-21T07:50:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:02 smithi187 ceph-mon[34367]: pgmap v800: 97 pgs: 97 active+clean; 487 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 282 op/s 2024-09-21T07:50:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:02 smithi123 ceph-mon[34166]: pgmap v800: 97 pgs: 97 active+clean; 487 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 282 op/s 2024-09-21T07:50:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:02 smithi060 ceph-mon[31244]: pgmap v800: 97 pgs: 97 active+clean; 487 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 282 op/s 2024-09-21T07:50:02.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 54791 20.62 MB/sec execute 19 sec latency 82.531 ms 2024-09-21T07:50:03.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 55355 21.00 MB/sec execute 20 sec latency 53.866 ms 2024-09-21T07:50:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:04 smithi187 ceph-mon[34367]: pgmap v801: 97 pgs: 97 active+clean; 479 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.9 MiB/s wr, 392 op/s 2024-09-21T07:50:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:04 smithi123 ceph-mon[34166]: pgmap v801: 97 pgs: 97 active+clean; 479 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.9 MiB/s wr, 392 op/s 2024-09-21T07:50:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:04 smithi060 ceph-mon[31244]: pgmap v801: 97 pgs: 97 active+clean; 479 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.9 MiB/s wr, 392 op/s 2024-09-21T07:50:04.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 55884 22.00 MB/sec execute 21 sec latency 59.190 ms 2024-09-21T07:50:05.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 56325 22.17 MB/sec execute 22 sec latency 203.077 ms 2024-09-21T07:50:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:06 smithi187 ceph-mon[34367]: pgmap v802: 97 pgs: 97 active+clean; 471 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.4 MiB/s wr, 349 op/s 2024-09-21T07:50:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:06 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:50:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:06 smithi123 ceph-mon[34166]: pgmap v802: 97 pgs: 97 active+clean; 471 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.4 MiB/s wr, 349 op/s 2024-09-21T07:50:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:06 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:50:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:06 smithi060 ceph-mon[31244]: pgmap v802: 97 pgs: 97 active+clean; 471 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.4 MiB/s wr, 349 op/s 2024-09-21T07:50:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:06 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:50:06.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 56603 21.79 MB/sec execute 23 sec latency 172.901 ms 2024-09-21T07:50:07.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 56895 21.71 MB/sec execute 24 sec latency 73.588 ms 2024-09-21T07:50:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:08 smithi187 ceph-mon[34367]: pgmap v803: 97 pgs: 97 active+clean; 466 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 337 op/s 2024-09-21T07:50:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:08 smithi123 ceph-mon[34166]: pgmap v803: 97 pgs: 97 active+clean; 466 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 337 op/s 2024-09-21T07:50:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:08 smithi060 ceph-mon[31244]: pgmap v803: 97 pgs: 97 active+clean; 466 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 337 op/s 2024-09-21T07:50:08.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 57183 21.44 MB/sec execute 25 sec latency 121.255 ms 2024-09-21T07:50:09.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 57467 21.03 MB/sec execute 26 sec latency 68.193 ms 2024-09-21T07:50:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:10 smithi123 ceph-mon[34166]: pgmap v804: 97 pgs: 97 active+clean; 471 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 327 op/s 2024-09-21T07:50:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:10 smithi060 ceph-mon[31244]: pgmap v804: 97 pgs: 97 active+clean; 471 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 327 op/s 2024-09-21T07:50:10.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 57744 20.80 MB/sec execute 27 sec latency 246.613 ms 2024-09-21T07:50:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:10 smithi187 ceph-mon[34367]: pgmap v804: 97 pgs: 97 active+clean; 471 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 327 op/s 2024-09-21T07:50:11.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 58199 20.75 MB/sec execute 28 sec latency 119.605 ms 2024-09-21T07:50:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:12 smithi123 ceph-mon[34166]: pgmap v805: 97 pgs: 97 active+clean; 474 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 308 op/s 2024-09-21T07:50:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:12 smithi060 ceph-mon[31244]: pgmap v805: 97 pgs: 97 active+clean; 474 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 308 op/s 2024-09-21T07:50:12.378 INFO:tasks.workunit.client.0.smithi060.stdout: 10 58678 20.71 MB/sec execute 29 sec latency 51.307 ms 2024-09-21T07:50:12.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:12 smithi187 ceph-mon[34367]: pgmap v805: 97 pgs: 97 active+clean; 474 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.4 MiB/s wr, 308 op/s 2024-09-21T07:50:13.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 59226 20.98 MB/sec execute 30 sec latency 48.079 ms 2024-09-21T07:50:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:14 smithi123 ceph-mon[34166]: pgmap v806: 97 pgs: 97 active+clean; 480 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.7 MiB/s wr, 385 op/s 2024-09-21T07:50:14.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:14 smithi060 ceph-mon[31244]: pgmap v806: 97 pgs: 97 active+clean; 480 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.7 MiB/s wr, 385 op/s 2024-09-21T07:50:14.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 59740 21.52 MB/sec execute 31 sec latency 50.771 ms 2024-09-21T07:50:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:14 smithi187 ceph-mon[34367]: pgmap v806: 97 pgs: 97 active+clean; 480 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.7 MiB/s wr, 385 op/s 2024-09-21T07:50:15.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 60138 21.66 MB/sec execute 32 sec latency 152.160 ms 2024-09-21T07:50:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:16 smithi123 ceph-mon[34166]: pgmap v807: 97 pgs: 97 active+clean; 485 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.4 MiB/s wr, 331 op/s 2024-09-21T07:50:16.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:16 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:50:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:16 smithi060 ceph-mon[31244]: pgmap v807: 97 pgs: 97 active+clean; 485 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.4 MiB/s wr, 331 op/s 2024-09-21T07:50:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:16 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:50:16.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 60388 21.47 MB/sec execute 33 sec latency 112.074 ms 2024-09-21T07:50:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:16 smithi187 ceph-mon[34367]: pgmap v807: 97 pgs: 97 active+clean; 485 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.4 MiB/s wr, 331 op/s 2024-09-21T07:50:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:16 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:50:17.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 60695 21.27 MB/sec execute 34 sec latency 191.629 ms 2024-09-21T07:50:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:18 smithi123 ceph-mon[34166]: pgmap v808: 97 pgs: 97 active+clean; 482 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 348 op/s 2024-09-21T07:50:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:50:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:50:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:18 smithi060 ceph-mon[31244]: pgmap v808: 97 pgs: 97 active+clean; 482 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 348 op/s 2024-09-21T07:50:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:50:18.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:50:18.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 60994 21.15 MB/sec execute 35 sec latency 125.714 ms 2024-09-21T07:50:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:18 smithi187 ceph-mon[34367]: pgmap v808: 97 pgs: 97 active+clean; 482 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 348 op/s 2024-09-21T07:50:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:50:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:50:18.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:50:18.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:50:19.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 61403 20.97 MB/sec execute 36 sec latency 60.537 ms 2024-09-21T07:50:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:20 smithi123 ceph-mon[34166]: pgmap v809: 97 pgs: 97 active+clean; 467 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 389 op/s 2024-09-21T07:50:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:20 smithi060 ceph-mon[31244]: pgmap v809: 97 pgs: 97 active+clean; 467 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 389 op/s 2024-09-21T07:50:20.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 61719 20.71 MB/sec execute 37 sec latency 221.114 ms 2024-09-21T07:50:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:20 smithi187 ceph-mon[34367]: pgmap v809: 97 pgs: 97 active+clean; 467 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 389 op/s 2024-09-21T07:50:21.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 62093 20.81 MB/sec execute 38 sec latency 125.976 ms 2024-09-21T07:50:22.320 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:22 smithi187 ceph-mon[34367]: pgmap v810: 97 pgs: 97 active+clean; 468 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 319 op/s 2024-09-21T07:50:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:22 smithi123 ceph-mon[34166]: pgmap v810: 97 pgs: 97 active+clean; 468 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 319 op/s 2024-09-21T07:50:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:22 smithi060 ceph-mon[31244]: pgmap v810: 97 pgs: 97 active+clean; 468 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 319 op/s 2024-09-21T07:50:22.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 62628 20.86 MB/sec execute 39 sec latency 55.397 ms 2024-09-21T07:50:23.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 63151 21.29 MB/sec execute 40 sec latency 56.300 ms 2024-09-21T07:50:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:24 smithi123 ceph-mon[34166]: pgmap v811: 97 pgs: 97 active+clean; 469 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.1 MiB/s wr, 376 op/s 2024-09-21T07:50:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:24 smithi060 ceph-mon[31244]: pgmap v811: 97 pgs: 97 active+clean; 469 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.1 MiB/s wr, 376 op/s 2024-09-21T07:50:24.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 63646 21.50 MB/sec execute 41 sec latency 58.671 ms 2024-09-21T07:50:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:24 smithi187 ceph-mon[34367]: pgmap v811: 97 pgs: 97 active+clean; 469 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.1 MiB/s wr, 376 op/s 2024-09-21T07:50:25.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 63901 21.39 MB/sec execute 42 sec latency 180.237 ms 2024-09-21T07:50:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:26 smithi123 ceph-mon[34166]: pgmap v812: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 347 op/s 2024-09-21T07:50:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:26 smithi060 ceph-mon[31244]: pgmap v812: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 347 op/s 2024-09-21T07:50:26.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 64150 21.19 MB/sec execute 43 sec latency 184.594 ms 2024-09-21T07:50:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:26 smithi187 ceph-mon[34367]: pgmap v812: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 347 op/s 2024-09-21T07:50:27.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 64486 21.15 MB/sec execute 44 sec latency 55.191 ms 2024-09-21T07:50:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:28 smithi123 ceph-mon[34166]: pgmap v813: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 350 op/s 2024-09-21T07:50:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:28 smithi060 ceph-mon[31244]: pgmap v813: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 350 op/s 2024-09-21T07:50:28.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 64805 20.93 MB/sec execute 45 sec latency 110.728 ms 2024-09-21T07:50:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:28 smithi187 ceph-mon[34367]: pgmap v813: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 350 op/s 2024-09-21T07:50:29.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 65193 20.74 MB/sec execute 46 sec latency 82.622 ms 2024-09-21T07:50:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:30 smithi123 ceph-mon[34166]: pgmap v814: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 366 op/s 2024-09-21T07:50:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:30 smithi060 ceph-mon[31244]: pgmap v814: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 366 op/s 2024-09-21T07:50:30.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 65553 20.81 MB/sec execute 47 sec latency 108.317 ms 2024-09-21T07:50:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:30 smithi187 ceph-mon[34367]: pgmap v814: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 366 op/s 2024-09-21T07:50:31.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 66114 20.86 MB/sec execute 48 sec latency 160.071 ms 2024-09-21T07:50:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:32 smithi123 ceph-mon[34166]: pgmap v815: 97 pgs: 97 active+clean; 474 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 285 op/s 2024-09-21T07:50:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:32 smithi060 ceph-mon[31244]: pgmap v815: 97 pgs: 97 active+clean; 474 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 285 op/s 2024-09-21T07:50:32.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 66653 21.24 MB/sec execute 49 sec latency 49.343 ms 2024-09-21T07:50:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:32 smithi187 ceph-mon[34367]: pgmap v815: 97 pgs: 97 active+clean; 474 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 285 op/s 2024-09-21T07:50:33.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 67174 21.45 MB/sec execute 50 sec latency 64.146 ms 2024-09-21T07:50:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:34 smithi123 ceph-mon[34166]: pgmap v816: 97 pgs: 97 active+clean; 481 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 370 op/s 2024-09-21T07:50:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:34 smithi060 ceph-mon[31244]: pgmap v816: 97 pgs: 97 active+clean; 481 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 370 op/s 2024-09-21T07:50:34.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 67458 21.37 MB/sec execute 51 sec latency 59.743 ms 2024-09-21T07:50:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:34 smithi187 ceph-mon[34367]: pgmap v816: 97 pgs: 97 active+clean; 481 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 370 op/s 2024-09-21T07:50:35.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 67717 21.22 MB/sec execute 52 sec latency 114.990 ms 2024-09-21T07:50:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:36 smithi123 ceph-mon[34166]: pgmap v817: 97 pgs: 97 active+clean; 482 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.5 MiB/s wr, 325 op/s 2024-09-21T07:50:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:36 smithi060 ceph-mon[31244]: pgmap v817: 97 pgs: 97 active+clean; 482 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.5 MiB/s wr, 325 op/s 2024-09-21T07:50:36.379 INFO:tasks.workunit.client.0.smithi060.stdout: 10 67909 21.02 MB/sec execute 53 sec latency 295.039 ms 2024-09-21T07:50:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:36 smithi187 ceph-mon[34367]: pgmap v817: 97 pgs: 97 active+clean; 482 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.5 MiB/s wr, 325 op/s 2024-09-21T07:50:37.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 68227 20.94 MB/sec execute 54 sec latency 170.966 ms 2024-09-21T07:50:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:38 smithi123 ceph-mon[34166]: pgmap v818: 97 pgs: 97 active+clean; 480 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2024-09-21T07:50:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:38 smithi060 ceph-mon[31244]: pgmap v818: 97 pgs: 97 active+clean; 480 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2024-09-21T07:50:38.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 68651 20.77 MB/sec execute 55 sec latency 65.566 ms 2024-09-21T07:50:38.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:38 smithi187 ceph-mon[34367]: pgmap v818: 97 pgs: 97 active+clean; 480 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2024-09-21T07:50:39.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 69055 20.83 MB/sec execute 56 sec latency 78.362 ms 2024-09-21T07:50:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:40 smithi123 ceph-mon[34166]: pgmap v819: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.4 MiB/s wr, 358 op/s 2024-09-21T07:50:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:40 smithi060 ceph-mon[31244]: pgmap v819: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.4 MiB/s wr, 358 op/s 2024-09-21T07:50:40.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 69642 20.95 MB/sec execute 57 sec latency 51.786 ms 2024-09-21T07:50:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:40 smithi187 ceph-mon[34367]: pgmap v819: 97 pgs: 97 active+clean; 473 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.4 MiB/s wr, 358 op/s 2024-09-21T07:50:41.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 70013 20.99 MB/sec execute 58 sec latency 158.280 ms 2024-09-21T07:50:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:42 smithi123 ceph-mon[34166]: pgmap v820: 97 pgs: 97 active+clean; 472 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 308 op/s 2024-09-21T07:50:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:42 smithi060 ceph-mon[31244]: pgmap v820: 97 pgs: 97 active+clean; 472 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 308 op/s 2024-09-21T07:50:42.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 70445 21.10 MB/sec execute 59 sec latency 253.137 ms 2024-09-21T07:50:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:42 smithi187 ceph-mon[34367]: pgmap v820: 97 pgs: 97 active+clean; 472 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 308 op/s 2024-09-21T07:50:43.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 70847 21.13 MB/sec execute 60 sec latency 202.913 ms 2024-09-21T07:50:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:44 smithi123 ceph-mon[34166]: pgmap v821: 97 pgs: 97 active+clean; 465 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.8 MiB/s wr, 407 op/s 2024-09-21T07:50:44.374 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:44 smithi060 ceph-mon[31244]: pgmap v821: 97 pgs: 97 active+clean; 465 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.8 MiB/s wr, 407 op/s 2024-09-21T07:50:44.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 71128 21.10 MB/sec execute 61 sec latency 114.667 ms 2024-09-21T07:50:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:44 smithi187 ceph-mon[34367]: pgmap v821: 97 pgs: 97 active+clean; 465 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.8 MiB/s wr, 407 op/s 2024-09-21T07:50:45.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 71498 21.07 MB/sec execute 62 sec latency 113.352 ms 2024-09-21T07:50:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:46 smithi123 ceph-mon[34166]: pgmap v822: 97 pgs: 97 active+clean; 468 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.7 MiB/s wr, 378 op/s 2024-09-21T07:50:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:46 smithi060 ceph-mon[31244]: pgmap v822: 97 pgs: 97 active+clean; 468 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.7 MiB/s wr, 378 op/s 2024-09-21T07:50:46.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 71677 20.90 MB/sec execute 63 sec latency 546.990 ms 2024-09-21T07:50:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:46 smithi187 ceph-mon[34367]: pgmap v822: 97 pgs: 97 active+clean; 468 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.7 MiB/s wr, 378 op/s 2024-09-21T07:50:47.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 72063 20.78 MB/sec execute 64 sec latency 112.009 ms 2024-09-21T07:50:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:48 smithi123 ceph-mon[34166]: pgmap v823: 97 pgs: 97 active+clean; 481 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 476 op/s 2024-09-21T07:50:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:48 smithi060 ceph-mon[31244]: pgmap v823: 97 pgs: 97 active+clean; 481 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 476 op/s 2024-09-21T07:50:48.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 72507 20.86 MB/sec execute 65 sec latency 90.262 ms 2024-09-21T07:50:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:48 smithi187 ceph-mon[34367]: pgmap v823: 97 pgs: 97 active+clean; 481 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 476 op/s 2024-09-21T07:50:49.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 73040 20.90 MB/sec execute 66 sec latency 54.231 ms 2024-09-21T07:50:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:50 smithi123 ceph-mon[34166]: pgmap v824: 97 pgs: 97 active+clean; 481 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 500 op/s 2024-09-21T07:50:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:50 smithi060 ceph-mon[31244]: pgmap v824: 97 pgs: 97 active+clean; 481 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 500 op/s 2024-09-21T07:50:50.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 73479 21.01 MB/sec execute 67 sec latency 64.649 ms 2024-09-21T07:50:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:50 smithi187 ceph-mon[34367]: pgmap v824: 97 pgs: 97 active+clean; 481 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 500 op/s 2024-09-21T07:50:51.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 73805 20.96 MB/sec execute 68 sec latency 249.672 ms 2024-09-21T07:50:52.340 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:52 smithi187 ceph-mon[34367]: pgmap v825: 97 pgs: 97 active+clean; 480 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 401 op/s 2024-09-21T07:50:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:52 smithi123 ceph-mon[34166]: pgmap v825: 97 pgs: 97 active+clean; 480 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 401 op/s 2024-09-21T07:50:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:52 smithi060 ceph-mon[31244]: pgmap v825: 97 pgs: 97 active+clean; 480 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 401 op/s 2024-09-21T07:50:52.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 74131 20.92 MB/sec execute 69 sec latency 122.225 ms 2024-09-21T07:50:53.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 74461 20.93 MB/sec execute 70 sec latency 68.077 ms 2024-09-21T07:50:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:54 smithi123 ceph-mon[34166]: pgmap v826: 97 pgs: 97 active+clean; 477 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 480 op/s 2024-09-21T07:50:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:54 smithi060 ceph-mon[31244]: pgmap v826: 97 pgs: 97 active+clean; 477 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 480 op/s 2024-09-21T07:50:54.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 74812 20.87 MB/sec execute 71 sec latency 67.209 ms 2024-09-21T07:50:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:54 smithi187 ceph-mon[34367]: pgmap v826: 97 pgs: 97 active+clean; 477 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 480 op/s 2024-09-21T07:50:55.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 75164 20.87 MB/sec execute 72 sec latency 142.817 ms 2024-09-21T07:50:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:56 smithi123 ceph-mon[34166]: pgmap v827: 97 pgs: 97 active+clean; 482 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-09-21T07:50:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:56 smithi060 ceph-mon[31244]: pgmap v827: 97 pgs: 97 active+clean; 482 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-09-21T07:50:56.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 75481 20.73 MB/sec execute 73 sec latency 270.384 ms 2024-09-21T07:50:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:56 smithi187 ceph-mon[34367]: pgmap v827: 97 pgs: 97 active+clean; 482 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-09-21T07:50:57.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 75885 20.75 MB/sec execute 74 sec latency 98.769 ms 2024-09-21T07:50:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:50:58 smithi123 ceph-mon[34166]: pgmap v828: 97 pgs: 97 active+clean; 483 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 397 op/s 2024-09-21T07:50:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:50:58 smithi060 ceph-mon[31244]: pgmap v828: 97 pgs: 97 active+clean; 483 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 397 op/s 2024-09-21T07:50:58.380 INFO:tasks.workunit.client.0.smithi060.stdout: 10 76342 20.75 MB/sec execute 75 sec latency 200.784 ms 2024-09-21T07:50:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:50:58 smithi187 ceph-mon[34367]: pgmap v828: 97 pgs: 97 active+clean; 483 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 397 op/s 2024-09-21T07:50:59.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 76750 20.78 MB/sec execute 76 sec latency 73.299 ms 2024-09-21T07:51:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:00 smithi123 ceph-mon[34166]: pgmap v829: 97 pgs: 97 active+clean; 471 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 385 op/s 2024-09-21T07:51:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:00 smithi060 ceph-mon[31244]: pgmap v829: 97 pgs: 97 active+clean; 471 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 385 op/s 2024-09-21T07:51:00.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 77251 20.90 MB/sec execute 77 sec latency 44.267 ms 2024-09-21T07:51:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:00 smithi187 ceph-mon[34367]: pgmap v829: 97 pgs: 97 active+clean; 471 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 385 op/s 2024-09-21T07:51:01.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 77577 20.92 MB/sec execute 78 sec latency 204.979 ms 2024-09-21T07:51:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:02 smithi123 ceph-mon[34166]: pgmap v830: 97 pgs: 97 active+clean; 471 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 312 op/s 2024-09-21T07:51:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:02 smithi060 ceph-mon[31244]: pgmap v830: 97 pgs: 97 active+clean; 471 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 312 op/s 2024-09-21T07:51:02.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 77934 20.90 MB/sec execute 79 sec latency 74.889 ms 2024-09-21T07:51:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:02 smithi187 ceph-mon[34367]: pgmap v830: 97 pgs: 97 active+clean; 471 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 312 op/s 2024-09-21T07:51:03.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 78297 20.88 MB/sec execute 80 sec latency 71.608 ms 2024-09-21T07:51:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:04 smithi123 ceph-mon[34166]: pgmap v831: 97 pgs: 97 active+clean; 470 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-09-21T07:51:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:04 smithi060 ceph-mon[31244]: pgmap v831: 97 pgs: 97 active+clean; 470 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-09-21T07:51:04.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 78609 20.78 MB/sec execute 81 sec latency 79.713 ms 2024-09-21T07:51:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:04 smithi187 ceph-mon[34367]: pgmap v831: 97 pgs: 97 active+clean; 470 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-09-21T07:51:05.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 79038 20.77 MB/sec execute 82 sec latency 65.399 ms 2024-09-21T07:51:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:06 smithi123 ceph-mon[34166]: pgmap v832: 97 pgs: 97 active+clean; 473 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.2 MiB/s wr, 341 op/s 2024-09-21T07:51:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:06 smithi060 ceph-mon[31244]: pgmap v832: 97 pgs: 97 active+clean; 473 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.2 MiB/s wr, 341 op/s 2024-09-21T07:51:06.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 79369 20.73 MB/sec execute 83 sec latency 171.303 ms 2024-09-21T07:51:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:06 smithi187 ceph-mon[34367]: pgmap v832: 97 pgs: 97 active+clean; 473 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.2 MiB/s wr, 341 op/s 2024-09-21T07:51:07.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 79741 20.74 MB/sec execute 84 sec latency 177.275 ms 2024-09-21T07:51:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:07 smithi123 ceph-mon[34166]: pgmap v833: 97 pgs: 97 active+clean; 474 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 317 op/s 2024-09-21T07:51:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:07 smithi060 ceph-mon[31244]: pgmap v833: 97 pgs: 97 active+clean; 474 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 317 op/s 2024-09-21T07:51:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:07 smithi187 ceph-mon[34367]: pgmap v833: 97 pgs: 97 active+clean; 474 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 317 op/s 2024-09-21T07:51:08.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 80239 20.85 MB/sec execute 85 sec latency 67.341 ms 2024-09-21T07:51:09.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 80643 20.85 MB/sec execute 86 sec latency 48.984 ms 2024-09-21T07:51:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:09 smithi187 ceph-mon[34367]: pgmap v834: 97 pgs: 97 active+clean; 480 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 386 op/s 2024-09-21T07:51:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:09 smithi123 ceph-mon[34166]: pgmap v834: 97 pgs: 97 active+clean; 480 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 386 op/s 2024-09-21T07:51:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:09 smithi060 ceph-mon[31244]: pgmap v834: 97 pgs: 97 active+clean; 480 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 386 op/s 2024-09-21T07:51:10.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 81078 20.91 MB/sec execute 87 sec latency 68.197 ms 2024-09-21T07:51:11.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 81390 20.90 MB/sec execute 88 sec latency 184.240 ms 2024-09-21T07:51:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:11 smithi187 ceph-mon[34367]: pgmap v835: 97 pgs: 97 active+clean; 481 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 281 op/s 2024-09-21T07:51:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:11 smithi123 ceph-mon[34166]: pgmap v835: 97 pgs: 97 active+clean; 481 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 281 op/s 2024-09-21T07:51:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:11 smithi060 ceph-mon[31244]: pgmap v835: 97 pgs: 97 active+clean; 481 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 281 op/s 2024-09-21T07:51:12.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 81695 20.81 MB/sec execute 89 sec latency 202.122 ms 2024-09-21T07:51:13.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 82013 20.78 MB/sec execute 90 sec latency 80.229 ms 2024-09-21T07:51:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:13 smithi187 ceph-mon[34367]: pgmap v836: 97 pgs: 97 active+clean; 479 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 325 op/s 2024-09-21T07:51:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:13 smithi123 ceph-mon[34166]: pgmap v836: 97 pgs: 97 active+clean; 479 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 325 op/s 2024-09-21T07:51:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:13 smithi060 ceph-mon[31244]: pgmap v836: 97 pgs: 97 active+clean; 479 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 325 op/s 2024-09-21T07:51:14.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 82377 20.74 MB/sec execute 91 sec latency 147.696 ms 2024-09-21T07:51:15.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 82821 20.72 MB/sec execute 92 sec latency 83.463 ms 2024-09-21T07:51:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:15 smithi187 ceph-mon[34367]: pgmap v837: 97 pgs: 97 active+clean; 485 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.5 MiB/s wr, 322 op/s 2024-09-21T07:51:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:15 smithi123 ceph-mon[34166]: pgmap v837: 97 pgs: 97 active+clean; 485 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.5 MiB/s wr, 322 op/s 2024-09-21T07:51:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:15 smithi060 ceph-mon[31244]: pgmap v837: 97 pgs: 97 active+clean; 485 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.5 MiB/s wr, 322 op/s 2024-09-21T07:51:16.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 83239 20.75 MB/sec execute 93 sec latency 100.947 ms 2024-09-21T07:51:17.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 83587 20.74 MB/sec execute 94 sec latency 190.463 ms 2024-09-21T07:51:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:17 smithi187 ceph-mon[34367]: pgmap v838: 97 pgs: 97 active+clean; 488 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.0 MiB/s wr, 323 op/s 2024-09-21T07:51:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:17 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:17 smithi123 ceph-mon[34166]: pgmap v838: 97 pgs: 97 active+clean; 488 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.0 MiB/s wr, 323 op/s 2024-09-21T07:51:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:17 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:17 smithi060 ceph-mon[31244]: pgmap v838: 97 pgs: 97 active+clean; 488 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.0 MiB/s wr, 323 op/s 2024-09-21T07:51:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:17 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:51:18.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 84043 20.83 MB/sec execute 95 sec latency 62.936 ms 2024-09-21T07:51:19.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:19.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:19.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:18 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:51:19.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:19.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:19.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:18 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:51:19.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:51:19.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:51:19.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:18 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:51:19.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 84480 20.86 MB/sec execute 96 sec latency 84.769 ms 2024-09-21T07:51:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:20 smithi123 ceph-mon[34166]: pgmap v839: 97 pgs: 97 active+clean; 476 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 380 op/s 2024-09-21T07:51:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:20 smithi060 ceph-mon[31244]: pgmap v839: 97 pgs: 97 active+clean; 476 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 380 op/s 2024-09-21T07:51:20.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 84847 20.88 MB/sec execute 97 sec latency 72.146 ms 2024-09-21T07:51:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:20 smithi187 ceph-mon[34367]: pgmap v839: 97 pgs: 97 active+clean; 476 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 380 op/s 2024-09-21T07:51:21.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 85185 20.82 MB/sec execute 98 sec latency 74.539 ms 2024-09-21T07:51:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:22 smithi123 ceph-mon[34166]: pgmap v840: 97 pgs: 97 active+clean; 476 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.9 MiB/s wr, 282 op/s 2024-09-21T07:51:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:22 smithi060 ceph-mon[31244]: pgmap v840: 97 pgs: 97 active+clean; 476 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.9 MiB/s wr, 282 op/s 2024-09-21T07:51:22.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 85435 20.74 MB/sec execute 99 sec latency 285.465 ms 2024-09-21T07:51:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:22 smithi187 ceph-mon[34367]: pgmap v840: 97 pgs: 97 active+clean; 476 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.9 MiB/s wr, 282 op/s 2024-09-21T07:51:23.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 85751 20.67 MB/sec execute 100 sec latency 97.373 ms 2024-09-21T07:51:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:24 smithi123 ceph-mon[34166]: pgmap v841: 97 pgs: 97 active+clean; 471 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 371 op/s 2024-09-21T07:51:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:24 smithi060 ceph-mon[31244]: pgmap v841: 97 pgs: 97 active+clean; 471 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 371 op/s 2024-09-21T07:51:24.381 INFO:tasks.workunit.client.0.smithi060.stdout: 10 86231 20.69 MB/sec execute 101 sec latency 59.188 ms 2024-09-21T07:51:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:24 smithi187 ceph-mon[34367]: pgmap v841: 97 pgs: 97 active+clean; 471 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 371 op/s 2024-09-21T07:51:25.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 86654 20.72 MB/sec execute 102 sec latency 52.317 ms 2024-09-21T07:51:26.350 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:26 smithi123 ceph-mon[34166]: pgmap v842: 97 pgs: 97 active+clean; 470 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 348 op/s 2024-09-21T07:51:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:26 smithi060 ceph-mon[31244]: pgmap v842: 97 pgs: 97 active+clean; 470 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 348 op/s 2024-09-21T07:51:26.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 87181 20.80 MB/sec execute 103 sec latency 74.576 ms 2024-09-21T07:51:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:26 smithi187 ceph-mon[34367]: pgmap v842: 97 pgs: 97 active+clean; 470 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 348 op/s 2024-09-21T07:51:27.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 87548 20.86 MB/sec execute 104 sec latency 206.031 ms 2024-09-21T07:51:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:28 smithi060 ceph-mon[31244]: pgmap v843: 97 pgs: 97 active+clean; 469 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 319 op/s 2024-09-21T07:51:28.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 87977 20.87 MB/sec execute 105 sec latency 74.928 ms 2024-09-21T07:51:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:28 smithi187 ceph-mon[34367]: pgmap v843: 97 pgs: 97 active+clean; 469 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 319 op/s 2024-09-21T07:51:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:28 smithi123 ceph-mon[34166]: pgmap v843: 97 pgs: 97 active+clean; 469 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.6 MiB/s wr, 319 op/s 2024-09-21T07:51:29.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 88325 20.84 MB/sec execute 106 sec latency 82.706 ms 2024-09-21T07:51:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:30 smithi060 ceph-mon[31244]: pgmap v844: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.9 MiB/s wr, 383 op/s 2024-09-21T07:51:30.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 88677 20.83 MB/sec execute 107 sec latency 81.132 ms 2024-09-21T07:51:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:30 smithi187 ceph-mon[34367]: pgmap v844: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.9 MiB/s wr, 383 op/s 2024-09-21T07:51:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:30 smithi123 ceph-mon[34166]: pgmap v844: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.9 MiB/s wr, 383 op/s 2024-09-21T07:51:31.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 89057 20.83 MB/sec execute 108 sec latency 61.618 ms 2024-09-21T07:51:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:32 smithi060 ceph-mon[31244]: pgmap v845: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 298 op/s 2024-09-21T07:51:32.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 89333 20.76 MB/sec execute 109 sec latency 205.023 ms 2024-09-21T07:51:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:32 smithi187 ceph-mon[34367]: pgmap v845: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 298 op/s 2024-09-21T07:51:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:32 smithi123 ceph-mon[34166]: pgmap v845: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 298 op/s 2024-09-21T07:51:33.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 89748 20.73 MB/sec execute 110 sec latency 92.777 ms 2024-09-21T07:51:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:34 smithi060 ceph-mon[31244]: pgmap v846: 97 pgs: 97 active+clean; 482 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 387 op/s 2024-09-21T07:51:34.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 90185 20.76 MB/sec execute 111 sec latency 61.774 ms 2024-09-21T07:51:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:34 smithi187 ceph-mon[34367]: pgmap v846: 97 pgs: 97 active+clean; 482 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 387 op/s 2024-09-21T07:51:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:34 smithi123 ceph-mon[34166]: pgmap v846: 97 pgs: 97 active+clean; 482 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 387 op/s 2024-09-21T07:51:35.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 90604 20.79 MB/sec execute 112 sec latency 66.077 ms 2024-09-21T07:51:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:36 smithi060 ceph-mon[31244]: pgmap v847: 97 pgs: 97 active+clean; 484 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 338 op/s 2024-09-21T07:51:36.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 91028 20.86 MB/sec execute 113 sec latency 57.964 ms 2024-09-21T07:51:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:36 smithi187 ceph-mon[34367]: pgmap v847: 97 pgs: 97 active+clean; 484 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 338 op/s 2024-09-21T07:51:36.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:36 smithi123 ceph-mon[34166]: pgmap v847: 97 pgs: 97 active+clean; 484 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 338 op/s 2024-09-21T07:51:37.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 91316 20.80 MB/sec execute 114 sec latency 165.586 ms 2024-09-21T07:51:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:38 smithi060 ceph-mon[31244]: pgmap v848: 97 pgs: 97 active+clean; 483 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 364 op/s 2024-09-21T07:51:38.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 91693 20.79 MB/sec execute 115 sec latency 75.393 ms 2024-09-21T07:51:38.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:38 smithi187 ceph-mon[34367]: pgmap v848: 97 pgs: 97 active+clean; 483 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 364 op/s 2024-09-21T07:51:38.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:38 smithi123 ceph-mon[34166]: pgmap v848: 97 pgs: 97 active+clean; 483 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 364 op/s 2024-09-21T07:51:39.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 92107 20.80 MB/sec execute 116 sec latency 75.728 ms 2024-09-21T07:51:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:40 smithi060 ceph-mon[31244]: pgmap v849: 97 pgs: 97 active+clean; 468 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-09-21T07:51:40.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 92507 20.81 MB/sec execute 117 sec latency 77.299 ms 2024-09-21T07:51:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:40 smithi187 ceph-mon[34367]: pgmap v849: 97 pgs: 97 active+clean; 468 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-09-21T07:51:40.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:40 smithi123 ceph-mon[34166]: pgmap v849: 97 pgs: 97 active+clean; 468 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-09-21T07:51:41.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 92884 20.79 MB/sec execute 118 sec latency 62.101 ms 2024-09-21T07:51:42.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:42 smithi060 ceph-mon[31244]: pgmap v850: 97 pgs: 97 active+clean; 468 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 284 op/s 2024-09-21T07:51:42.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 93161 20.75 MB/sec execute 119 sec latency 242.969 ms 2024-09-21T07:51:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:42 smithi187 ceph-mon[34367]: pgmap v850: 97 pgs: 97 active+clean; 468 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 284 op/s 2024-09-21T07:51:42.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:42 smithi123 ceph-mon[34166]: pgmap v850: 97 pgs: 97 active+clean; 468 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 284 op/s 2024-09-21T07:51:43.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 93641 20.77 MB/sec execute 120 sec latency 67.934 ms 2024-09-21T07:51:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:44 smithi060 ceph-mon[31244]: pgmap v851: 97 pgs: 97 active+clean; 469 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.9 MiB/s wr, 387 op/s 2024-09-21T07:51:44.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 94083 20.79 MB/sec execute 121 sec latency 84.830 ms 2024-09-21T07:51:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:44 smithi187 ceph-mon[34367]: pgmap v851: 97 pgs: 97 active+clean; 469 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.9 MiB/s wr, 387 op/s 2024-09-21T07:51:44.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:44 smithi123 ceph-mon[34166]: pgmap v851: 97 pgs: 97 active+clean; 469 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.9 MiB/s wr, 387 op/s 2024-09-21T07:51:45.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 94514 20.87 MB/sec execute 122 sec latency 52.346 ms 2024-09-21T07:51:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:46 smithi060 ceph-mon[31244]: pgmap v852: 97 pgs: 97 active+clean; 472 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:51:46.382 INFO:tasks.workunit.client.0.smithi060.stdout: 10 94920 20.84 MB/sec execute 123 sec latency 77.682 ms 2024-09-21T07:51:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:46 smithi187 ceph-mon[34367]: pgmap v852: 97 pgs: 97 active+clean; 472 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:51:46.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:46 smithi123 ceph-mon[34166]: pgmap v852: 97 pgs: 97 active+clean; 472 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:51:47.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 95209 20.80 MB/sec execute 124 sec latency 261.427 ms 2024-09-21T07:51:48.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 95573 20.81 MB/sec execute 125 sec latency 96.063 ms 2024-09-21T07:51:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:48 smithi187 ceph-mon[34367]: pgmap v853: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 323 op/s 2024-09-21T07:51:48.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:48 smithi123 ceph-mon[34166]: pgmap v853: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 323 op/s 2024-09-21T07:51:48.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:48 smithi060 ceph-mon[31244]: pgmap v853: 97 pgs: 97 active+clean; 475 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 323 op/s 2024-09-21T07:51:49.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 95885 20.74 MB/sec execute 126 sec latency 111.184 ms 2024-09-21T07:51:50.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 96253 20.74 MB/sec execute 127 sec latency 91.026 ms 2024-09-21T07:51:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:50 smithi187 ceph-mon[34367]: pgmap v854: 97 pgs: 97 active+clean; 481 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 340 op/s 2024-09-21T07:51:50.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:50 smithi123 ceph-mon[34166]: pgmap v854: 97 pgs: 97 active+clean; 481 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 340 op/s 2024-09-21T07:51:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:50 smithi060 ceph-mon[31244]: pgmap v854: 97 pgs: 97 active+clean; 481 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 340 op/s 2024-09-21T07:51:51.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 96681 20.77 MB/sec execute 128 sec latency 68.789 ms 2024-09-21T07:51:52.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 97053 20.75 MB/sec execute 129 sec latency 168.986 ms 2024-09-21T07:51:52.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:52 smithi187 ceph-mon[34367]: pgmap v855: 97 pgs: 97 active+clean; 481 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.1 MiB/s wr, 283 op/s 2024-09-21T07:51:52.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:52 smithi123 ceph-mon[34166]: pgmap v855: 97 pgs: 97 active+clean; 481 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.1 MiB/s wr, 283 op/s 2024-09-21T07:51:52.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:52 smithi060 ceph-mon[31244]: pgmap v855: 97 pgs: 97 active+clean; 481 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.1 MiB/s wr, 283 op/s 2024-09-21T07:51:53.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 97492 20.76 MB/sec execute 130 sec latency 137.950 ms 2024-09-21T07:51:54.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 97897 20.80 MB/sec execute 131 sec latency 97.325 ms 2024-09-21T07:51:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:54 smithi187 ceph-mon[34367]: pgmap v856: 97 pgs: 97 active+clean; 483 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.3 MiB/s wr, 350 op/s 2024-09-21T07:51:54.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:54 smithi123 ceph-mon[34166]: pgmap v856: 97 pgs: 97 active+clean; 483 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.3 MiB/s wr, 350 op/s 2024-09-21T07:51:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:54 smithi060 ceph-mon[31244]: pgmap v856: 97 pgs: 97 active+clean; 483 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.3 MiB/s wr, 350 op/s 2024-09-21T07:51:55.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 98321 20.83 MB/sec execute 132 sec latency 75.039 ms 2024-09-21T07:51:56.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 98703 20.82 MB/sec execute 133 sec latency 84.659 ms 2024-09-21T07:51:56.400 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:56 smithi123 ceph-mon[34166]: pgmap v857: 97 pgs: 97 active+clean; 487 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 302 op/s 2024-09-21T07:51:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:56 smithi187 ceph-mon[34367]: pgmap v857: 97 pgs: 97 active+clean; 487 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 302 op/s 2024-09-21T07:51:56.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:56 smithi060 ceph-mon[31244]: pgmap v857: 97 pgs: 97 active+clean; 487 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 302 op/s 2024-09-21T07:51:57.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 98976 20.74 MB/sec execute 134 sec latency 133.684 ms 2024-09-21T07:51:58.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 99264 20.74 MB/sec execute 135 sec latency 267.933 ms 2024-09-21T07:51:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:51:58 smithi187 ceph-mon[34367]: pgmap v858: 97 pgs: 97 active+clean; 489 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.9 MiB/s wr, 334 op/s 2024-09-21T07:51:58.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:51:58 smithi123 ceph-mon[34166]: pgmap v858: 97 pgs: 97 active+clean; 489 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.9 MiB/s wr, 334 op/s 2024-09-21T07:51:58.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:51:58 smithi060 ceph-mon[31244]: pgmap v858: 97 pgs: 97 active+clean; 489 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.9 MiB/s wr, 334 op/s 2024-09-21T07:51:59.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 99623 20.72 MB/sec execute 136 sec latency 88.960 ms 2024-09-21T07:52:00.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 99992 20.70 MB/sec execute 137 sec latency 78.333 ms 2024-09-21T07:52:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:00 smithi187 ceph-mon[34367]: pgmap v859: 97 pgs: 97 active+clean; 493 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 353 op/s 2024-09-21T07:52:00.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:00 smithi123 ceph-mon[34166]: pgmap v859: 97 pgs: 97 active+clean; 493 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 353 op/s 2024-09-21T07:52:00.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:00 smithi060 ceph-mon[31244]: pgmap v859: 97 pgs: 97 active+clean; 493 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 353 op/s 2024-09-21T07:52:01.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 100423 20.70 MB/sec execute 138 sec latency 73.049 ms 2024-09-21T07:52:02.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 100885 20.77 MB/sec execute 139 sec latency 51.774 ms 2024-09-21T07:52:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:02 smithi187 ceph-mon[34367]: pgmap v860: 97 pgs: 97 active+clean; 493 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 290 op/s 2024-09-21T07:52:02.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:02 smithi123 ceph-mon[34166]: pgmap v860: 97 pgs: 97 active+clean; 493 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 290 op/s 2024-09-21T07:52:02.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:02 smithi060 ceph-mon[31244]: pgmap v860: 97 pgs: 97 active+clean; 493 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.8 MiB/s wr, 290 op/s 2024-09-21T07:52:03.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 101210 20.73 MB/sec execute 140 sec latency 250.221 ms 2024-09-21T07:52:04.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 101603 20.76 MB/sec execute 141 sec latency 61.989 ms 2024-09-21T07:52:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:04 smithi187 ceph-mon[34367]: pgmap v861: 97 pgs: 97 active+clean; 487 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.3 MiB/s wr, 395 op/s 2024-09-21T07:52:04.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:04 smithi123 ceph-mon[34166]: pgmap v861: 97 pgs: 97 active+clean; 487 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.3 MiB/s wr, 395 op/s 2024-09-21T07:52:04.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:04 smithi060 ceph-mon[31244]: pgmap v861: 97 pgs: 97 active+clean; 487 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.3 MiB/s wr, 395 op/s 2024-09-21T07:52:05.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 101942 20.75 MB/sec execute 142 sec latency 79.546 ms 2024-09-21T07:52:06.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 102312 20.72 MB/sec execute 143 sec latency 77.288 ms 2024-09-21T07:52:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:06 smithi187 ceph-mon[34367]: pgmap v862: 97 pgs: 97 active+clean; 475 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-09-21T07:52:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:06 smithi123 ceph-mon[34166]: pgmap v862: 97 pgs: 97 active+clean; 475 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-09-21T07:52:06.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:06 smithi060 ceph-mon[31244]: pgmap v862: 97 pgs: 97 active+clean; 475 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-09-21T07:52:07.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 102677 20.71 MB/sec execute 144 sec latency 58.258 ms 2024-09-21T07:52:08.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 102906 20.65 MB/sec execute 145 sec latency 302.216 ms 2024-09-21T07:52:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:08 smithi187 ceph-mon[34367]: pgmap v863: 97 pgs: 97 active+clean; 478 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 358 op/s 2024-09-21T07:52:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:08 smithi123 ceph-mon[34166]: pgmap v863: 97 pgs: 97 active+clean; 478 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 358 op/s 2024-09-21T07:52:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:08 smithi060 ceph-mon[31244]: pgmap v863: 97 pgs: 97 active+clean; 478 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 358 op/s 2024-09-21T07:52:09.383 INFO:tasks.workunit.client.0.smithi060.stdout: 10 103258 20.67 MB/sec execute 146 sec latency 81.028 ms 2024-09-21T07:52:10.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 103654 20.64 MB/sec execute 147 sec latency 94.797 ms 2024-09-21T07:52:10.631 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:10 smithi123 ceph-mon[34166]: pgmap v864: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 374 op/s 2024-09-21T07:52:10.632 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:10 smithi187 ceph-mon[34367]: pgmap v864: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 374 op/s 2024-09-21T07:52:10.632 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:10 smithi060 ceph-mon[31244]: pgmap v864: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 374 op/s 2024-09-21T07:52:11.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 104025 20.63 MB/sec execute 148 sec latency 76.912 ms 2024-09-21T07:52:12.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 104515 20.66 MB/sec execute 149 sec latency 69.951 ms 2024-09-21T07:52:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:12 smithi187 ceph-mon[34367]: pgmap v865: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 301 op/s 2024-09-21T07:52:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:12 smithi123 ceph-mon[34166]: pgmap v865: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 301 op/s 2024-09-21T07:52:12.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:12 smithi060 ceph-mon[31244]: pgmap v865: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 301 op/s 2024-09-21T07:52:13.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 104877 20.68 MB/sec execute 150 sec latency 275.320 ms 2024-09-21T07:52:14.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 105215 20.65 MB/sec execute 151 sec latency 117.095 ms 2024-09-21T07:52:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:14 smithi187 ceph-mon[34367]: pgmap v866: 97 pgs: 97 active+clean; 482 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.5 MiB/s wr, 362 op/s 2024-09-21T07:52:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:14 smithi123 ceph-mon[34166]: pgmap v866: 97 pgs: 97 active+clean; 482 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.5 MiB/s wr, 362 op/s 2024-09-21T07:52:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:14 smithi060 ceph-mon[31244]: pgmap v866: 97 pgs: 97 active+clean; 482 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.5 MiB/s wr, 362 op/s 2024-09-21T07:52:15.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 105606 20.67 MB/sec execute 152 sec latency 69.629 ms 2024-09-21T07:52:16.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 105996 20.64 MB/sec execute 153 sec latency 67.248 ms 2024-09-21T07:52:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:16 smithi187 ceph-mon[34367]: pgmap v867: 97 pgs: 97 active+clean; 489 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 333 op/s 2024-09-21T07:52:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:16 smithi123 ceph-mon[34166]: pgmap v867: 97 pgs: 97 active+clean; 489 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 333 op/s 2024-09-21T07:52:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:16 smithi060 ceph-mon[31244]: pgmap v867: 97 pgs: 97 active+clean; 489 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 333 op/s 2024-09-21T07:52:17.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 106345 20.65 MB/sec execute 154 sec latency 73.692 ms 2024-09-21T07:52:18.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 106625 20.62 MB/sec execute 155 sec latency 247.387 ms 2024-09-21T07:52:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:18 smithi187 ceph-mon[34367]: pgmap v868: 97 pgs: 97 active+clean; 488 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 329 op/s 2024-09-21T07:52:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:18 smithi123 ceph-mon[34166]: pgmap v868: 97 pgs: 97 active+clean; 488 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 329 op/s 2024-09-21T07:52:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:18 smithi060 ceph-mon[31244]: pgmap v868: 97 pgs: 97 active+clean; 488 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 329 op/s 2024-09-21T07:52:19.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 107034 20.61 MB/sec execute 156 sec latency 133.184 ms 2024-09-21T07:52:19.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:19.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:19.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:19.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:52:19.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:52:19.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:52:19.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:52:19.623 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:52:20.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 107423 20.60 MB/sec execute 157 sec latency 65.230 ms 2024-09-21T07:52:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi187 to 176.0M 2024-09-21T07:52:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: Unable to set osd_memory_target on smithi187 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T07:52:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T07:52:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:52:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: pgmap v869: 97 pgs: 97 active+clean; 492 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 365 op/s 2024-09-21T07:52:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-21T07:52:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:20 smithi187 ceph-mon[34367]: Unable to set osd_memory_target on smithi123 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-21T07:52:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi187 to 176.0M 2024-09-21T07:52:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: Unable to set osd_memory_target on smithi187 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T07:52:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T07:52:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:52:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: pgmap v869: 97 pgs: 97 active+clean; 492 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 365 op/s 2024-09-21T07:52:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-21T07:52:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:20 smithi123 ceph-mon[34166]: Unable to set osd_memory_target on smithi123 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-21T07:52:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi187 to 176.0M 2024-09-21T07:52:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: Unable to set osd_memory_target on smithi187 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T07:52:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T07:52:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:52:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: pgmap v869: 97 pgs: 97 active+clean; 492 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 365 op/s 2024-09-21T07:52:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: Adjusting osd_memory_target on smithi123 to 176.0M 2024-09-21T07:52:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:20 smithi060 ceph-mon[31244]: Unable to set osd_memory_target on smithi123 to 184587468: error parsing value: Value '184587468' is below minimum 939524096 2024-09-21T07:52:21.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 107935 20.66 MB/sec execute 158 sec latency 98.295 ms 2024-09-21T07:52:22.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 108362 20.70 MB/sec execute 159 sec latency 266.306 ms 2024-09-21T07:52:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:22 smithi187 ceph-mon[34367]: pgmap v870: 97 pgs: 97 active+clean; 492 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 302 op/s 2024-09-21T07:52:22.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:22 smithi123 ceph-mon[34166]: pgmap v870: 97 pgs: 97 active+clean; 492 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 302 op/s 2024-09-21T07:52:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:22 smithi060 ceph-mon[31244]: pgmap v870: 97 pgs: 97 active+clean; 492 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 302 op/s 2024-09-21T07:52:23.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 108677 20.67 MB/sec execute 160 sec latency 247.492 ms 2024-09-21T07:52:24.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 108994 20.67 MB/sec execute 161 sec latency 83.024 ms 2024-09-21T07:52:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:24 smithi187 ceph-mon[34367]: pgmap v871: 97 pgs: 97 active+clean; 488 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.4 MiB/s wr, 394 op/s 2024-09-21T07:52:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:24 smithi123 ceph-mon[34166]: pgmap v871: 97 pgs: 97 active+clean; 488 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.4 MiB/s wr, 394 op/s 2024-09-21T07:52:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:24 smithi060 ceph-mon[31244]: pgmap v871: 97 pgs: 97 active+clean; 488 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.4 MiB/s wr, 394 op/s 2024-09-21T07:52:25.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 109423 20.65 MB/sec execute 162 sec latency 69.035 ms 2024-09-21T07:52:26.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 109786 20.63 MB/sec execute 163 sec latency 93.698 ms 2024-09-21T07:52:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:26 smithi187 ceph-mon[34367]: pgmap v872: 97 pgs: 97 active+clean; 475 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 351 op/s 2024-09-21T07:52:26.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:26 smithi123 ceph-mon[34166]: pgmap v872: 97 pgs: 97 active+clean; 475 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 351 op/s 2024-09-21T07:52:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:26 smithi060 ceph-mon[31244]: pgmap v872: 97 pgs: 97 active+clean; 475 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 351 op/s 2024-09-21T07:52:27.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 110110 20.61 MB/sec execute 164 sec latency 72.074 ms 2024-09-21T07:52:28.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 110453 20.61 MB/sec execute 165 sec latency 233.529 ms 2024-09-21T07:52:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:28 smithi187 ceph-mon[34367]: pgmap v873: 97 pgs: 97 active+clean; 478 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 330 op/s 2024-09-21T07:52:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:28 smithi123 ceph-mon[34166]: pgmap v873: 97 pgs: 97 active+clean; 478 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 330 op/s 2024-09-21T07:52:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:28 smithi060 ceph-mon[31244]: pgmap v873: 97 pgs: 97 active+clean; 478 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.1 MiB/s wr, 330 op/s 2024-09-21T07:52:29.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 110863 20.61 MB/sec execute 166 sec latency 130.159 ms 2024-09-21T07:52:30.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 111343 20.66 MB/sec execute 167 sec latency 85.551 ms 2024-09-21T07:52:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:30 smithi187 ceph-mon[34367]: pgmap v874: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 377 op/s 2024-09-21T07:52:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:30 smithi123 ceph-mon[34166]: pgmap v874: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 377 op/s 2024-09-21T07:52:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:30 smithi060 ceph-mon[31244]: pgmap v874: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 377 op/s 2024-09-21T07:52:31.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 111848 20.72 MB/sec execute 168 sec latency 57.607 ms 2024-09-21T07:52:32.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 112238 20.71 MB/sec execute 169 sec latency 88.447 ms 2024-09-21T07:52:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:32 smithi187 ceph-mon[34367]: pgmap v875: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-09-21T07:52:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:32 smithi123 ceph-mon[34166]: pgmap v875: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-09-21T07:52:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:32 smithi060 ceph-mon[31244]: pgmap v875: 97 pgs: 97 active+clean; 481 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-09-21T07:52:33.384 INFO:tasks.workunit.client.0.smithi060.stdout: 10 112515 20.70 MB/sec execute 170 sec latency 228.287 ms 2024-09-21T07:52:34.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 112844 20.65 MB/sec execute 171 sec latency 80.343 ms 2024-09-21T07:52:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:34 smithi187 ceph-mon[34367]: pgmap v876: 97 pgs: 97 active+clean; 486 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 376 op/s 2024-09-21T07:52:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:34 smithi123 ceph-mon[34166]: pgmap v876: 97 pgs: 97 active+clean; 486 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 376 op/s 2024-09-21T07:52:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:34 smithi060 ceph-mon[31244]: pgmap v876: 97 pgs: 97 active+clean; 486 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 376 op/s 2024-09-21T07:52:35.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 113182 20.62 MB/sec execute 172 sec latency 85.559 ms 2024-09-21T07:52:36.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 113590 20.62 MB/sec execute 173 sec latency 56.392 ms 2024-09-21T07:52:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:36 smithi187 ceph-mon[34367]: pgmap v877: 97 pgs: 97 active+clean; 487 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 317 op/s 2024-09-21T07:52:36.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:36 smithi123 ceph-mon[34166]: pgmap v877: 97 pgs: 97 active+clean; 487 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 317 op/s 2024-09-21T07:52:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:36 smithi060 ceph-mon[31244]: pgmap v877: 97 pgs: 97 active+clean; 487 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 317 op/s 2024-09-21T07:52:37.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 114093 20.66 MB/sec execute 174 sec latency 63.735 ms 2024-09-21T07:52:38.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:37 smithi123 ceph-mon[34166]: pgmap v878: 97 pgs: 97 active+clean; 487 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 335 op/s 2024-09-21T07:52:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:37 smithi060 ceph-mon[31244]: pgmap v878: 97 pgs: 97 active+clean; 487 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 335 op/s 2024-09-21T07:52:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:37 smithi187 ceph-mon[34367]: pgmap v878: 97 pgs: 97 active+clean; 487 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 335 op/s 2024-09-21T07:52:38.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 114490 20.64 MB/sec execute 175 sec latency 136.675 ms 2024-09-21T07:52:39.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 114871 20.67 MB/sec execute 176 sec latency 215.468 ms 2024-09-21T07:52:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:39 smithi187 ceph-mon[34367]: pgmap v879: 97 pgs: 97 active+clean; 493 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 370 op/s 2024-09-21T07:52:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:39 smithi123 ceph-mon[34166]: pgmap v879: 97 pgs: 97 active+clean; 493 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 370 op/s 2024-09-21T07:52:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:39 smithi060 ceph-mon[31244]: pgmap v879: 97 pgs: 97 active+clean; 493 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 370 op/s 2024-09-21T07:52:40.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 115339 20.73 MB/sec execute 177 sec latency 68.757 ms 2024-09-21T07:52:41.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 115712 20.71 MB/sec execute 178 sec latency 79.528 ms 2024-09-21T07:52:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:41 smithi187 ceph-mon[34367]: pgmap v880: 97 pgs: 97 active+clean; 493 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 293 op/s 2024-09-21T07:52:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:41 smithi123 ceph-mon[34166]: pgmap v880: 97 pgs: 97 active+clean; 493 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 293 op/s 2024-09-21T07:52:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:41 smithi060 ceph-mon[31244]: pgmap v880: 97 pgs: 97 active+clean; 493 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.6 MiB/s wr, 293 op/s 2024-09-21T07:52:42.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 115989 20.69 MB/sec execute 179 sec latency 219.246 ms 2024-09-21T07:52:43.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 116402 20.70 MB/sec execute 180 sec latency 55.196 ms 2024-09-21T07:52:44.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:43 smithi187 ceph-mon[34367]: pgmap v881: 97 pgs: 97 active+clean; 474 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-09-21T07:52:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:43 smithi123 ceph-mon[34166]: pgmap v881: 97 pgs: 97 active+clean; 474 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-09-21T07:52:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:43 smithi060 ceph-mon[31244]: pgmap v881: 97 pgs: 97 active+clean; 474 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-09-21T07:52:44.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 116680 20.64 MB/sec execute 181 sec latency 263.265 ms 2024-09-21T07:52:45.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 117018 20.62 MB/sec execute 182 sec latency 86.955 ms 2024-09-21T07:52:46.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:45 smithi187 ceph-mon[34367]: pgmap v882: 97 pgs: 97 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.7 MiB/s wr, 315 op/s 2024-09-21T07:52:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:45 smithi123 ceph-mon[34166]: pgmap v882: 97 pgs: 97 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.7 MiB/s wr, 315 op/s 2024-09-21T07:52:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:45 smithi060 ceph-mon[31244]: pgmap v882: 97 pgs: 97 active+clean; 468 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.7 MiB/s wr, 315 op/s 2024-09-21T07:52:46.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 117465 20.67 MB/sec execute 183 sec latency 64.196 ms 2024-09-21T07:52:47.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 118004 20.67 MB/sec execute 184 sec latency 61.509 ms 2024-09-21T07:52:48.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:47 smithi187 ceph-mon[34367]: pgmap v883: 97 pgs: 97 active+clean; 471 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 333 op/s 2024-09-21T07:52:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:47 smithi123 ceph-mon[34166]: pgmap v883: 97 pgs: 97 active+clean; 471 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 333 op/s 2024-09-21T07:52:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:47 smithi060 ceph-mon[31244]: pgmap v883: 97 pgs: 97 active+clean; 471 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 333 op/s 2024-09-21T07:52:48.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 118431 20.71 MB/sec execute 185 sec latency 57.225 ms 2024-09-21T07:52:49.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 118790 20.71 MB/sec execute 186 sec latency 250.715 ms 2024-09-21T07:52:50.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:49 smithi187 ceph-mon[34367]: pgmap v884: 97 pgs: 97 active+clean; 477 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 385 op/s 2024-09-21T07:52:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:49 smithi123 ceph-mon[34166]: pgmap v884: 97 pgs: 97 active+clean; 477 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 385 op/s 2024-09-21T07:52:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:49 smithi060 ceph-mon[31244]: pgmap v884: 97 pgs: 97 active+clean; 477 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 385 op/s 2024-09-21T07:52:50.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 119144 20.70 MB/sec execute 187 sec latency 116.129 ms 2024-09-21T07:52:51.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 119498 20.71 MB/sec execute 188 sec latency 66.699 ms 2024-09-21T07:52:52.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:51 smithi187 ceph-mon[34367]: pgmap v885: 97 pgs: 97 active+clean; 476 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 293 op/s 2024-09-21T07:52:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:51 smithi123 ceph-mon[34166]: pgmap v885: 97 pgs: 97 active+clean; 476 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 293 op/s 2024-09-21T07:52:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:51 smithi060 ceph-mon[31244]: pgmap v885: 97 pgs: 97 active+clean; 476 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 293 op/s 2024-09-21T07:52:52.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 119879 20.71 MB/sec execute 189 sec latency 63.292 ms 2024-09-21T07:52:53.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 120228 20.67 MB/sec execute 190 sec latency 94.857 ms 2024-09-21T07:52:54.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:53 smithi187 ceph-mon[34367]: pgmap v886: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-09-21T07:52:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:53 smithi123 ceph-mon[34166]: pgmap v886: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-09-21T07:52:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:53 smithi060 ceph-mon[31244]: pgmap v886: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-09-21T07:52:54.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 120515 20.64 MB/sec execute 191 sec latency 237.090 ms 2024-09-21T07:52:55.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 120872 20.64 MB/sec execute 192 sec latency 67.254 ms 2024-09-21T07:52:56.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:55 smithi187 ceph-mon[34367]: pgmap v887: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 336 op/s 2024-09-21T07:52:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:55 smithi123 ceph-mon[34166]: pgmap v887: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 336 op/s 2024-09-21T07:52:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:55 smithi060 ceph-mon[31244]: pgmap v887: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 336 op/s 2024-09-21T07:52:56.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 121368 20.65 MB/sec execute 193 sec latency 54.729 ms 2024-09-21T07:52:57.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 121860 20.67 MB/sec execute 194 sec latency 70.847 ms 2024-09-21T07:52:58.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:57 smithi187 ceph-mon[34367]: pgmap v888: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 327 op/s 2024-09-21T07:52:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:57 smithi123 ceph-mon[34166]: pgmap v888: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 327 op/s 2024-09-21T07:52:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:57 smithi060 ceph-mon[31244]: pgmap v888: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 327 op/s 2024-09-21T07:52:58.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 122334 20.75 MB/sec execute 195 sec latency 63.759 ms 2024-09-21T07:52:59.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 122633 20.70 MB/sec execute 196 sec latency 218.559 ms 2024-09-21T07:53:00.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:52:59 smithi187 ceph-mon[34367]: pgmap v889: 97 pgs: 97 active+clean; 489 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.2 MiB/s wr, 373 op/s 2024-09-21T07:53:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:52:59 smithi123 ceph-mon[34166]: pgmap v889: 97 pgs: 97 active+clean; 489 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.2 MiB/s wr, 373 op/s 2024-09-21T07:53:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:52:59 smithi060 ceph-mon[31244]: pgmap v889: 97 pgs: 97 active+clean; 489 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.2 MiB/s wr, 373 op/s 2024-09-21T07:53:00.385 INFO:tasks.workunit.client.0.smithi060.stdout: 10 122969 20.71 MB/sec execute 197 sec latency 148.841 ms 2024-09-21T07:53:01.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 123311 20.71 MB/sec execute 198 sec latency 143.686 ms 2024-09-21T07:53:02.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:01 smithi187 ceph-mon[34367]: pgmap v890: 97 pgs: 97 active+clean; 489 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2024-09-21T07:53:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:01 smithi123 ceph-mon[34166]: pgmap v890: 97 pgs: 97 active+clean; 489 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2024-09-21T07:53:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:01 smithi060 ceph-mon[31244]: pgmap v890: 97 pgs: 97 active+clean; 489 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2024-09-21T07:53:02.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 123721 20.69 MB/sec execute 199 sec latency 165.997 ms 2024-09-21T07:53:03.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 124046 20.67 MB/sec execute 200 sec latency 88.061 ms 2024-09-21T07:53:04.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:03 smithi187 ceph-mon[34367]: pgmap v891: 97 pgs: 97 active+clean; 481 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 338 op/s 2024-09-21T07:53:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:03 smithi123 ceph-mon[34166]: pgmap v891: 97 pgs: 97 active+clean; 481 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 338 op/s 2024-09-21T07:53:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:03 smithi060 ceph-mon[31244]: pgmap v891: 97 pgs: 97 active+clean; 481 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 338 op/s 2024-09-21T07:53:04.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 124357 20.65 MB/sec execute 201 sec latency 269.430 ms 2024-09-21T07:53:05.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 124790 20.66 MB/sec execute 202 sec latency 137.203 ms 2024-09-21T07:53:06.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:05 smithi187 ceph-mon[34367]: pgmap v892: 97 pgs: 97 active+clean; 471 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.6 MiB/s wr, 335 op/s 2024-09-21T07:53:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:05 smithi123 ceph-mon[34166]: pgmap v892: 97 pgs: 97 active+clean; 471 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.6 MiB/s wr, 335 op/s 2024-09-21T07:53:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:05 smithi060 ceph-mon[31244]: pgmap v892: 97 pgs: 97 active+clean; 471 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.6 MiB/s wr, 335 op/s 2024-09-21T07:53:06.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 125254 20.67 MB/sec execute 203 sec latency 94.374 ms 2024-09-21T07:53:07.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 125725 20.72 MB/sec execute 204 sec latency 81.996 ms 2024-09-21T07:53:08.098 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:07 smithi123 ceph-mon[34166]: pgmap v893: 97 pgs: 97 active+clean; 472 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.9 MiB/s wr, 332 op/s 2024-09-21T07:53:08.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:07 smithi060 ceph-mon[31244]: pgmap v893: 97 pgs: 97 active+clean; 472 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.9 MiB/s wr, 332 op/s 2024-09-21T07:53:08.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:07 smithi187 ceph-mon[34367]: pgmap v893: 97 pgs: 97 active+clean; 472 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.9 MiB/s wr, 332 op/s 2024-09-21T07:53:08.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 126144 20.74 MB/sec execute 205 sec latency 49.107 ms 2024-09-21T07:53:09.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 126407 20.70 MB/sec execute 206 sec latency 248.089 ms 2024-09-21T07:53:10.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:09 smithi187 ceph-mon[34367]: pgmap v894: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.6 MiB/s wr, 392 op/s 2024-09-21T07:53:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:09 smithi123 ceph-mon[34166]: pgmap v894: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.6 MiB/s wr, 392 op/s 2024-09-21T07:53:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:09 smithi060 ceph-mon[31244]: pgmap v894: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.6 MiB/s wr, 392 op/s 2024-09-21T07:53:10.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 126700 20.68 MB/sec execute 207 sec latency 95.523 ms 2024-09-21T07:53:11.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 127058 20.66 MB/sec execute 208 sec latency 104.477 ms 2024-09-21T07:53:12.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:11 smithi187 ceph-mon[34367]: pgmap v895: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.0 MiB/s wr, 294 op/s 2024-09-21T07:53:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:11 smithi123 ceph-mon[34166]: pgmap v895: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.0 MiB/s wr, 294 op/s 2024-09-21T07:53:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:11 smithi060 ceph-mon[31244]: pgmap v895: 97 pgs: 97 active+clean; 479 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.0 MiB/s wr, 294 op/s 2024-09-21T07:53:12.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 127437 20.64 MB/sec execute 209 sec latency 66.525 ms 2024-09-21T07:53:13.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 127846 20.66 MB/sec execute 210 sec latency 48.179 ms 2024-09-21T07:53:14.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:13 smithi187 ceph-mon[34367]: pgmap v896: 97 pgs: 97 active+clean; 481 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-21T07:53:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:13 smithi123 ceph-mon[34166]: pgmap v896: 97 pgs: 97 active+clean; 481 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-21T07:53:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:13 smithi060 ceph-mon[31244]: pgmap v896: 97 pgs: 97 active+clean; 481 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-21T07:53:14.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 128249 20.66 MB/sec execute 211 sec latency 206.651 ms 2024-09-21T07:53:15.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 128684 20.66 MB/sec execute 212 sec latency 180.740 ms 2024-09-21T07:53:16.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:15 smithi187 ceph-mon[34367]: pgmap v897: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 353 op/s 2024-09-21T07:53:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:15 smithi123 ceph-mon[34166]: pgmap v897: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 353 op/s 2024-09-21T07:53:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:15 smithi060 ceph-mon[31244]: pgmap v897: 97 pgs: 97 active+clean; 482 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 353 op/s 2024-09-21T07:53:16.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 129171 20.70 MB/sec execute 213 sec latency 73.448 ms 2024-09-21T07:53:17.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 129603 20.73 MB/sec execute 214 sec latency 62.366 ms 2024-09-21T07:53:18.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:17 smithi187 ceph-mon[34367]: pgmap v898: 97 pgs: 97 active+clean; 484 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 334 op/s 2024-09-21T07:53:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:17 smithi123 ceph-mon[34166]: pgmap v898: 97 pgs: 97 active+clean; 484 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 334 op/s 2024-09-21T07:53:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:17 smithi060 ceph-mon[31244]: pgmap v898: 97 pgs: 97 active+clean; 484 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 334 op/s 2024-09-21T07:53:18.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 129978 20.73 MB/sec execute 215 sec latency 101.423 ms 2024-09-21T07:53:19.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 130238 20.72 MB/sec execute 216 sec latency 200.833 ms 2024-09-21T07:53:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:19 smithi187 ceph-mon[34367]: pgmap v899: 97 pgs: 97 active+clean; 490 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 382 op/s 2024-09-21T07:53:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:20.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:20.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:19 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:53:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:19 smithi123 ceph-mon[34166]: pgmap v899: 97 pgs: 97 active+clean; 490 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 382 op/s 2024-09-21T07:53:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:19 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:53:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:19 smithi060 ceph-mon[31244]: pgmap v899: 97 pgs: 97 active+clean; 490 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 382 op/s 2024-09-21T07:53:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:53:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:53:20.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:53:20.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:19 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:53:20.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 130462 20.67 MB/sec execute 217 sec latency 356.248 ms 2024-09-21T07:53:21.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 130837 20.65 MB/sec execute 218 sec latency 161.998 ms 2024-09-21T07:53:22.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:21 smithi187 ceph-mon[34367]: pgmap v900: 97 pgs: 97 active+clean; 490 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 291 op/s 2024-09-21T07:53:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:21 smithi123 ceph-mon[34166]: pgmap v900: 97 pgs: 97 active+clean; 490 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 291 op/s 2024-09-21T07:53:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:21 smithi060 ceph-mon[31244]: pgmap v900: 97 pgs: 97 active+clean; 490 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 291 op/s 2024-09-21T07:53:22.386 INFO:tasks.workunit.client.0.smithi060.stdout: 10 131168 20.63 MB/sec execute 219 sec latency 73.040 ms 2024-09-21T07:53:23.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 131580 20.60 MB/sec execute 220 sec latency 70.396 ms 2024-09-21T07:53:24.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:23 smithi187 ceph-mon[34367]: pgmap v901: 97 pgs: 97 active+clean; 483 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 400 op/s 2024-09-21T07:53:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:23 smithi123 ceph-mon[34166]: pgmap v901: 97 pgs: 97 active+clean; 483 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 400 op/s 2024-09-21T07:53:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:23 smithi060 ceph-mon[31244]: pgmap v901: 97 pgs: 97 active+clean; 483 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.2 MiB/s wr, 400 op/s 2024-09-21T07:53:24.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 131968 20.63 MB/sec execute 221 sec latency 164.785 ms 2024-09-21T07:53:25.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 132346 20.62 MB/sec execute 222 sec latency 215.652 ms 2024-09-21T07:53:26.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:25 smithi187 ceph-mon[34367]: pgmap v902: 97 pgs: 97 active+clean; 472 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-09-21T07:53:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:25 smithi123 ceph-mon[34166]: pgmap v902: 97 pgs: 97 active+clean; 472 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-09-21T07:53:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:25 smithi060 ceph-mon[31244]: pgmap v902: 97 pgs: 97 active+clean; 472 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-09-21T07:53:26.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 132796 20.66 MB/sec execute 223 sec latency 58.638 ms 2024-09-21T07:53:27.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 133170 20.67 MB/sec execute 224 sec latency 71.437 ms 2024-09-21T07:53:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:27 smithi187 ceph-mon[34367]: pgmap v903: 97 pgs: 97 active+clean; 474 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 360 op/s 2024-09-21T07:53:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:27 smithi123 ceph-mon[34166]: pgmap v903: 97 pgs: 97 active+clean; 474 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 360 op/s 2024-09-21T07:53:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:27 smithi060 ceph-mon[31244]: pgmap v903: 97 pgs: 97 active+clean; 474 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 360 op/s 2024-09-21T07:53:28.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 133539 20.67 MB/sec execute 225 sec latency 73.726 ms 2024-09-21T07:53:29.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 133830 20.66 MB/sec execute 226 sec latency 110.865 ms 2024-09-21T07:53:30.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:29 smithi187 ceph-mon[34367]: pgmap v904: 97 pgs: 97 active+clean; 477 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 377 op/s 2024-09-21T07:53:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:29 smithi123 ceph-mon[34166]: pgmap v904: 97 pgs: 97 active+clean; 477 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 377 op/s 2024-09-21T07:53:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:29 smithi060 ceph-mon[31244]: pgmap v904: 97 pgs: 97 active+clean; 477 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 377 op/s 2024-09-21T07:53:30.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 134017 20.60 MB/sec execute 227 sec latency 358.359 ms 2024-09-21T07:53:31.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 134448 20.59 MB/sec execute 228 sec latency 77.701 ms 2024-09-21T07:53:32.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:32 smithi187 ceph-mon[34367]: pgmap v905: 97 pgs: 97 active+clean; 480 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 307 op/s 2024-09-21T07:53:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:32 smithi123 ceph-mon[34166]: pgmap v905: 97 pgs: 97 active+clean; 480 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 307 op/s 2024-09-21T07:53:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:32 smithi060 ceph-mon[31244]: pgmap v905: 97 pgs: 97 active+clean; 480 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.1 MiB/s wr, 307 op/s 2024-09-21T07:53:32.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 134848 20.57 MB/sec execute 229 sec latency 93.216 ms 2024-09-21T07:53:33.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 135309 20.58 MB/sec execute 230 sec latency 89.209 ms 2024-09-21T07:53:34.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:34 smithi187 ceph-mon[34367]: pgmap v906: 97 pgs: 97 active+clean; 483 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.6 MiB/s wr, 390 op/s 2024-09-21T07:53:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:34 smithi123 ceph-mon[34166]: pgmap v906: 97 pgs: 97 active+clean; 483 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.6 MiB/s wr, 390 op/s 2024-09-21T07:53:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:34 smithi060 ceph-mon[31244]: pgmap v906: 97 pgs: 97 active+clean; 483 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.6 MiB/s wr, 390 op/s 2024-09-21T07:53:34.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 135814 20.63 MB/sec execute 231 sec latency 74.486 ms 2024-09-21T07:53:35.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 136222 20.65 MB/sec execute 232 sec latency 187.393 ms 2024-09-21T07:53:36.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:36 smithi187 ceph-mon[34367]: pgmap v907: 97 pgs: 97 active+clean; 484 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.4 MiB/s wr, 302 op/s 2024-09-21T07:53:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:36 smithi123 ceph-mon[34166]: pgmap v907: 97 pgs: 97 active+clean; 484 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.4 MiB/s wr, 302 op/s 2024-09-21T07:53:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:36 smithi060 ceph-mon[31244]: pgmap v907: 97 pgs: 97 active+clean; 484 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.4 MiB/s wr, 302 op/s 2024-09-21T07:53:36.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 136643 20.68 MB/sec execute 233 sec latency 79.324 ms 2024-09-21T07:53:37.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 137040 20.69 MB/sec execute 234 sec latency 65.757 ms 2024-09-21T07:53:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:38 smithi187 ceph-mon[34367]: pgmap v908: 97 pgs: 97 active+clean; 486 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 344 op/s 2024-09-21T07:53:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:38 smithi123 ceph-mon[34166]: pgmap v908: 97 pgs: 97 active+clean; 486 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 344 op/s 2024-09-21T07:53:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:38 smithi060 ceph-mon[31244]: pgmap v908: 97 pgs: 97 active+clean; 486 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 344 op/s 2024-09-21T07:53:38.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 137342 20.67 MB/sec execute 235 sec latency 88.911 ms 2024-09-21T07:53:39.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 137646 20.64 MB/sec execute 236 sec latency 75.483 ms 2024-09-21T07:53:40.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:40 smithi187 ceph-mon[34367]: pgmap v909: 97 pgs: 97 active+clean; 490 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 360 op/s 2024-09-21T07:53:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:40 smithi123 ceph-mon[34166]: pgmap v909: 97 pgs: 97 active+clean; 490 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 360 op/s 2024-09-21T07:53:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:40 smithi060 ceph-mon[31244]: pgmap v909: 97 pgs: 97 active+clean; 490 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 360 op/s 2024-09-21T07:53:40.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 137942 20.60 MB/sec execute 237 sec latency 252.764 ms 2024-09-21T07:53:41.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 138206 20.57 MB/sec execute 238 sec latency 100.048 ms 2024-09-21T07:53:42.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:42 smithi187 ceph-mon[34367]: pgmap v910: 97 pgs: 97 active+clean; 494 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 291 op/s 2024-09-21T07:53:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:42 smithi123 ceph-mon[34166]: pgmap v910: 97 pgs: 97 active+clean; 494 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 291 op/s 2024-09-21T07:53:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:42 smithi060 ceph-mon[31244]: pgmap v910: 97 pgs: 97 active+clean; 494 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 291 op/s 2024-09-21T07:53:42.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 138578 20.55 MB/sec execute 239 sec latency 150.874 ms 2024-09-21T07:53:43.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 139036 20.57 MB/sec execute 240 sec latency 61.248 ms 2024-09-21T07:53:44.270 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:44 smithi187 ceph-mon[34367]: pgmap v911: 97 pgs: 97 active+clean; 486 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.5 MiB/s wr, 377 op/s 2024-09-21T07:53:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:44 smithi123 ceph-mon[34166]: pgmap v911: 97 pgs: 97 active+clean; 486 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.5 MiB/s wr, 377 op/s 2024-09-21T07:53:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:44 smithi060 ceph-mon[31244]: pgmap v911: 97 pgs: 97 active+clean; 486 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.5 MiB/s wr, 377 op/s 2024-09-21T07:53:44.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 139572 20.61 MB/sec execute 241 sec latency 88.824 ms 2024-09-21T07:53:45.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 139914 20.61 MB/sec execute 242 sec latency 311.460 ms 2024-09-21T07:53:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:46 smithi123 ceph-mon[34166]: pgmap v912: 97 pgs: 97 active+clean; 478 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.4 MiB/s wr, 309 op/s 2024-09-21T07:53:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:46 smithi060 ceph-mon[31244]: pgmap v912: 97 pgs: 97 active+clean; 478 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.4 MiB/s wr, 309 op/s 2024-09-21T07:53:46.387 INFO:tasks.workunit.client.0.smithi060.stdout: 10 140288 20.64 MB/sec execute 243 sec latency 77.276 ms 2024-09-21T07:53:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:46 smithi187 ceph-mon[34367]: pgmap v912: 97 pgs: 97 active+clean; 478 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.4 MiB/s wr, 309 op/s 2024-09-21T07:53:47.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 140662 20.64 MB/sec execute 244 sec latency 73.808 ms 2024-09-21T07:53:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:48 smithi123 ceph-mon[34166]: pgmap v913: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 381 op/s 2024-09-21T07:53:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:48 smithi060 ceph-mon[31244]: pgmap v913: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 381 op/s 2024-09-21T07:53:48.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 140946 20.62 MB/sec execute 245 sec latency 85.818 ms 2024-09-21T07:53:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:48 smithi187 ceph-mon[34367]: pgmap v913: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 381 op/s 2024-09-21T07:53:49.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 141292 20.60 MB/sec execute 246 sec latency 74.286 ms 2024-09-21T07:53:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:50 smithi123 ceph-mon[34166]: pgmap v914: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 350 op/s 2024-09-21T07:53:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:50 smithi060 ceph-mon[31244]: pgmap v914: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 350 op/s 2024-09-21T07:53:50.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 141556 20.55 MB/sec execute 247 sec latency 233.204 ms 2024-09-21T07:53:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:50 smithi187 ceph-mon[34367]: pgmap v914: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 350 op/s 2024-09-21T07:53:51.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 141846 20.52 MB/sec execute 248 sec latency 201.566 ms 2024-09-21T07:53:52.321 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:52 smithi187 ceph-mon[34367]: pgmap v915: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 287 op/s 2024-09-21T07:53:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:52 smithi123 ceph-mon[34166]: pgmap v915: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 287 op/s 2024-09-21T07:53:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:52 smithi060 ceph-mon[31244]: pgmap v915: 97 pgs: 97 active+clean; 481 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 287 op/s 2024-09-21T07:53:52.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 142320 20.53 MB/sec execute 249 sec latency 54.198 ms 2024-09-21T07:53:53.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 142864 20.58 MB/sec execute 250 sec latency 59.387 ms 2024-09-21T07:53:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:54 smithi123 ceph-mon[34166]: pgmap v916: 97 pgs: 97 active+clean; 487 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.9 MiB/s wr, 375 op/s 2024-09-21T07:53:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:54 smithi060 ceph-mon[31244]: pgmap v916: 97 pgs: 97 active+clean; 487 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.9 MiB/s wr, 375 op/s 2024-09-21T07:53:54.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 143369 20.60 MB/sec execute 251 sec latency 56.185 ms 2024-09-21T07:53:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:54 smithi187 ceph-mon[34367]: pgmap v916: 97 pgs: 97 active+clean; 487 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.9 MiB/s wr, 375 op/s 2024-09-21T07:53:55.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 143727 20.64 MB/sec execute 252 sec latency 227.704 ms 2024-09-21T07:53:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:56 smithi123 ceph-mon[34166]: pgmap v917: 97 pgs: 97 active+clean; 492 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 330 op/s 2024-09-21T07:53:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:56 smithi060 ceph-mon[31244]: pgmap v917: 97 pgs: 97 active+clean; 492 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 330 op/s 2024-09-21T07:53:56.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 144070 20.63 MB/sec execute 253 sec latency 127.446 ms 2024-09-21T07:53:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:56 smithi187 ceph-mon[34367]: pgmap v917: 97 pgs: 97 active+clean; 492 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 330 op/s 2024-09-21T07:53:57.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 144350 20.62 MB/sec execute 254 sec latency 96.760 ms 2024-09-21T07:53:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:53:58 smithi123 ceph-mon[34166]: pgmap v918: 97 pgs: 97 active+clean; 489 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-09-21T07:53:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:53:58 smithi060 ceph-mon[31244]: pgmap v918: 97 pgs: 97 active+clean; 489 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-09-21T07:53:58.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 144632 20.58 MB/sec execute 255 sec latency 125.730 ms 2024-09-21T07:53:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:53:58 smithi187 ceph-mon[34367]: pgmap v918: 97 pgs: 97 active+clean; 489 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-09-21T07:53:59.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 144980 20.56 MB/sec execute 256 sec latency 99.413 ms 2024-09-21T07:54:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:00 smithi123 ceph-mon[34166]: pgmap v919: 97 pgs: 97 active+clean; 495 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-09-21T07:54:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:00 smithi060 ceph-mon[31244]: pgmap v919: 97 pgs: 97 active+clean; 495 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-09-21T07:54:00.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 145268 20.52 MB/sec execute 257 sec latency 210.827 ms 2024-09-21T07:54:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:00 smithi187 ceph-mon[34367]: pgmap v919: 97 pgs: 97 active+clean; 495 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-09-21T07:54:01.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 145623 20.51 MB/sec execute 258 sec latency 228.025 ms 2024-09-21T07:54:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:02 smithi123 ceph-mon[34166]: pgmap v920: 97 pgs: 97 active+clean; 495 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 310 op/s 2024-09-21T07:54:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:02 smithi060 ceph-mon[31244]: pgmap v920: 97 pgs: 97 active+clean; 495 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 310 op/s 2024-09-21T07:54:02.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 146123 20.54 MB/sec execute 259 sec latency 70.253 ms 2024-09-21T07:54:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:02 smithi187 ceph-mon[34367]: pgmap v920: 97 pgs: 97 active+clean; 495 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 310 op/s 2024-09-21T07:54:03.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 146695 20.57 MB/sec execute 260 sec latency 60.491 ms 2024-09-21T07:54:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:04 smithi123 ceph-mon[34166]: pgmap v921: 97 pgs: 97 active+clean; 496 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 355 op/s 2024-09-21T07:54:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:04 smithi060 ceph-mon[31244]: pgmap v921: 97 pgs: 97 active+clean; 496 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 355 op/s 2024-09-21T07:54:04.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 147049 20.60 MB/sec execute 261 sec latency 168.419 ms 2024-09-21T07:54:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:04 smithi187 ceph-mon[34367]: pgmap v921: 97 pgs: 97 active+clean; 496 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 355 op/s 2024-09-21T07:54:05.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 147449 20.64 MB/sec execute 262 sec latency 133.444 ms 2024-09-21T07:54:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:06 smithi123 ceph-mon[34166]: pgmap v922: 97 pgs: 97 active+clean; 501 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 335 op/s 2024-09-21T07:54:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:06 smithi060 ceph-mon[31244]: pgmap v922: 97 pgs: 97 active+clean; 501 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 335 op/s 2024-09-21T07:54:06.388 INFO:tasks.workunit.client.0.smithi060.stdout: 10 147707 20.60 MB/sec execute 263 sec latency 239.416 ms 2024-09-21T07:54:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:06 smithi187 ceph-mon[34367]: pgmap v922: 97 pgs: 97 active+clean; 501 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 335 op/s 2024-09-21T07:54:07.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 147925 20.56 MB/sec execute 264 sec latency 151.662 ms 2024-09-21T07:54:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:08 smithi123 ceph-mon[34166]: pgmap v923: 97 pgs: 97 active+clean; 496 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.6 MiB/s wr, 324 op/s 2024-09-21T07:54:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:08 smithi060 ceph-mon[31244]: pgmap v923: 97 pgs: 97 active+clean; 496 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.6 MiB/s wr, 324 op/s 2024-09-21T07:54:08.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 148204 20.54 MB/sec execute 265 sec latency 79.728 ms 2024-09-21T07:54:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:08 smithi187 ceph-mon[34367]: pgmap v923: 97 pgs: 97 active+clean; 496 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.6 MiB/s wr, 324 op/s 2024-09-21T07:54:09.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 148493 20.49 MB/sec execute 266 sec latency 93.150 ms 2024-09-21T07:54:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:10 smithi123 ceph-mon[34166]: pgmap v924: 97 pgs: 97 active+clean; 479 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 357 op/s 2024-09-21T07:54:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:10 smithi060 ceph-mon[31244]: pgmap v924: 97 pgs: 97 active+clean; 479 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 357 op/s 2024-09-21T07:54:10.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 148926 20.48 MB/sec execute 267 sec latency 104.231 ms 2024-09-21T07:54:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:10 smithi187 ceph-mon[34367]: pgmap v924: 97 pgs: 97 active+clean; 479 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 357 op/s 2024-09-21T07:54:11.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 149291 20.49 MB/sec execute 268 sec latency 204.083 ms 2024-09-21T07:54:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:12 smithi123 ceph-mon[34166]: pgmap v925: 97 pgs: 97 active+clean; 479 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.1 MiB/s wr, 271 op/s 2024-09-21T07:54:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:12 smithi060 ceph-mon[31244]: pgmap v925: 97 pgs: 97 active+clean; 479 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.1 MiB/s wr, 271 op/s 2024-09-21T07:54:12.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 149763 20.49 MB/sec execute 269 sec latency 70.744 ms 2024-09-21T07:54:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:12 smithi187 ceph-mon[34367]: pgmap v925: 97 pgs: 97 active+clean; 479 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.1 MiB/s wr, 271 op/s 2024-09-21T07:54:13.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 150266 20.52 MB/sec execute 270 sec latency 46.911 ms 2024-09-21T07:54:14.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:14 smithi123 ceph-mon[34166]: pgmap v926: 97 pgs: 97 active+clean; 482 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.3 MiB/s wr, 352 op/s 2024-09-21T07:54:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:14 smithi060 ceph-mon[31244]: pgmap v926: 97 pgs: 97 active+clean; 482 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.3 MiB/s wr, 352 op/s 2024-09-21T07:54:14.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 150721 20.58 MB/sec execute 271 sec latency 54.981 ms 2024-09-21T07:54:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:14 smithi187 ceph-mon[34367]: pgmap v926: 97 pgs: 97 active+clean; 482 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.3 MiB/s wr, 352 op/s 2024-09-21T07:54:15.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 151110 20.61 MB/sec execute 272 sec latency 66.608 ms 2024-09-21T07:54:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:16 smithi123 ceph-mon[34166]: pgmap v927: 97 pgs: 97 active+clean; 486 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 360 op/s 2024-09-21T07:54:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:16 smithi060 ceph-mon[31244]: pgmap v927: 97 pgs: 97 active+clean; 486 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 360 op/s 2024-09-21T07:54:16.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 151301 20.55 MB/sec execute 273 sec latency 257.675 ms 2024-09-21T07:54:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:16 smithi187 ceph-mon[34367]: pgmap v927: 97 pgs: 97 active+clean; 486 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 360 op/s 2024-09-21T07:54:17.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 151543 20.51 MB/sec execute 274 sec latency 81.314 ms 2024-09-21T07:54:18.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:18 smithi123 ceph-mon[34166]: pgmap v928: 97 pgs: 97 active+clean; 488 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 337 op/s 2024-09-21T07:54:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:18 smithi060 ceph-mon[31244]: pgmap v928: 97 pgs: 97 active+clean; 488 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 337 op/s 2024-09-21T07:54:18.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 151880 20.50 MB/sec execute 275 sec latency 81.431 ms 2024-09-21T07:54:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:18 smithi187 ceph-mon[34367]: pgmap v928: 97 pgs: 97 active+clean; 488 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 337 op/s 2024-09-21T07:54:19.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 152329 20.49 MB/sec execute 276 sec latency 58.911 ms 2024-09-21T07:54:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:20 smithi123 ceph-mon[34166]: pgmap v929: 97 pgs: 97 active+clean; 492 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-09-21T07:54:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:20.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:54:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:20 smithi060 ceph-mon[31244]: pgmap v929: 97 pgs: 97 active+clean; 492 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-09-21T07:54:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:20.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:20.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:20.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:54:20.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 152811 20.51 MB/sec execute 277 sec latency 55.195 ms 2024-09-21T07:54:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:20 smithi187 ceph-mon[34367]: pgmap v929: 97 pgs: 97 active+clean; 492 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-09-21T07:54:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:54:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:54:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:54:20.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:54:21.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 153215 20.50 MB/sec execute 278 sec latency 185.497 ms 2024-09-21T07:54:22.321 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:22 smithi187 ceph-mon[34367]: pgmap v930: 97 pgs: 97 active+clean; 492 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 299 op/s 2024-09-21T07:54:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:22 smithi123 ceph-mon[34166]: pgmap v930: 97 pgs: 97 active+clean; 492 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 299 op/s 2024-09-21T07:54:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:22 smithi060 ceph-mon[31244]: pgmap v930: 97 pgs: 97 active+clean; 492 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 299 op/s 2024-09-21T07:54:22.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 153797 20.55 MB/sec execute 279 sec latency 52.015 ms 2024-09-21T07:54:23.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 154188 20.58 MB/sec execute 280 sec latency 96.224 ms 2024-09-21T07:54:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:24 smithi123 ceph-mon[34166]: pgmap v931: 97 pgs: 97 active+clean; 495 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-09-21T07:54:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:24 smithi060 ceph-mon[31244]: pgmap v931: 97 pgs: 97 active+clean; 495 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-09-21T07:54:24.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 154481 20.58 MB/sec execute 281 sec latency 164.964 ms 2024-09-21T07:54:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:24 smithi187 ceph-mon[34367]: pgmap v931: 97 pgs: 97 active+clean; 495 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-09-21T07:54:25.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 154780 20.57 MB/sec execute 282 sec latency 105.053 ms 2024-09-21T07:54:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:26 smithi123 ceph-mon[34166]: pgmap v932: 97 pgs: 97 active+clean; 500 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 337 op/s 2024-09-21T07:54:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:26 smithi060 ceph-mon[31244]: pgmap v932: 97 pgs: 97 active+clean; 500 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 337 op/s 2024-09-21T07:54:26.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 154942 20.52 MB/sec execute 283 sec latency 362.332 ms 2024-09-21T07:54:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:26 smithi187 ceph-mon[34367]: pgmap v932: 97 pgs: 97 active+clean; 500 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 337 op/s 2024-09-21T07:54:27.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 155186 20.47 MB/sec execute 284 sec latency 226.179 ms 2024-09-21T07:54:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:28 smithi123 ceph-mon[34166]: pgmap v933: 97 pgs: 97 active+clean; 501 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:54:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:28 smithi060 ceph-mon[31244]: pgmap v933: 97 pgs: 97 active+clean; 501 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:54:28.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 155504 20.46 MB/sec execute 285 sec latency 117.908 ms 2024-09-21T07:54:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:28 smithi187 ceph-mon[34367]: pgmap v933: 97 pgs: 97 active+clean; 501 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:54:29.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 155866 20.44 MB/sec execute 286 sec latency 134.124 ms 2024-09-21T07:54:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:30 smithi123 ceph-mon[34166]: pgmap v934: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.9 MiB/s wr, 368 op/s 2024-09-21T07:54:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:30 smithi060 ceph-mon[31244]: pgmap v934: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.9 MiB/s wr, 368 op/s 2024-09-21T07:54:30.389 INFO:tasks.workunit.client.0.smithi060.stdout: 10 156335 20.43 MB/sec execute 287 sec latency 98.568 ms 2024-09-21T07:54:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:30 smithi187 ceph-mon[34367]: pgmap v934: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.9 MiB/s wr, 368 op/s 2024-09-21T07:54:31.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 156777 20.47 MB/sec execute 288 sec latency 230.486 ms 2024-09-21T07:54:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:32 smithi123 ceph-mon[34166]: pgmap v935: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 294 op/s 2024-09-21T07:54:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:32 smithi060 ceph-mon[31244]: pgmap v935: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 294 op/s 2024-09-21T07:54:32.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 157336 20.51 MB/sec execute 289 sec latency 63.428 ms 2024-09-21T07:54:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:32 smithi187 ceph-mon[34367]: pgmap v935: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 294 op/s 2024-09-21T07:54:33.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 157754 20.54 MB/sec execute 290 sec latency 64.197 ms 2024-09-21T07:54:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:34 smithi123 ceph-mon[34166]: pgmap v936: 97 pgs: 97 active+clean; 481 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 356 op/s 2024-09-21T07:54:34.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:34 smithi060 ceph-mon[31244]: pgmap v936: 97 pgs: 97 active+clean; 481 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 356 op/s 2024-09-21T07:54:34.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 158117 20.56 MB/sec execute 291 sec latency 72.223 ms 2024-09-21T07:54:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:34 smithi187 ceph-mon[34367]: pgmap v936: 97 pgs: 97 active+clean; 481 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 356 op/s 2024-09-21T07:54:35.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 158392 20.53 MB/sec execute 292 sec latency 81.466 ms 2024-09-21T07:54:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:36 smithi123 ceph-mon[34166]: pgmap v937: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 323 op/s 2024-09-21T07:54:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:36 smithi060 ceph-mon[31244]: pgmap v937: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 323 op/s 2024-09-21T07:54:36.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 158615 20.48 MB/sec execute 293 sec latency 291.643 ms 2024-09-21T07:54:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:36 smithi187 ceph-mon[34367]: pgmap v937: 97 pgs: 97 active+clean; 483 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 323 op/s 2024-09-21T07:54:37.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 158908 20.46 MB/sec execute 294 sec latency 266.231 ms 2024-09-21T07:54:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:38 smithi123 ceph-mon[34166]: pgmap v938: 97 pgs: 97 active+clean; 493 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 311 op/s 2024-09-21T07:54:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:38 smithi060 ceph-mon[31244]: pgmap v938: 97 pgs: 97 active+clean; 493 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 311 op/s 2024-09-21T07:54:38.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 159241 20.43 MB/sec execute 295 sec latency 163.728 ms 2024-09-21T07:54:38.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:38 smithi187 ceph-mon[34367]: pgmap v938: 97 pgs: 97 active+clean; 493 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 311 op/s 2024-09-21T07:54:39.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 159726 20.44 MB/sec execute 296 sec latency 65.752 ms 2024-09-21T07:54:40.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:40 smithi123 ceph-mon[34166]: pgmap v939: 97 pgs: 97 active+clean; 500 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.3 MiB/s wr, 364 op/s 2024-09-21T07:54:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:40 smithi060 ceph-mon[31244]: pgmap v939: 97 pgs: 97 active+clean; 500 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.3 MiB/s wr, 364 op/s 2024-09-21T07:54:40.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 160257 20.48 MB/sec execute 297 sec latency 72.702 ms 2024-09-21T07:54:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:40 smithi187 ceph-mon[34367]: pgmap v939: 97 pgs: 97 active+clean; 500 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.3 MiB/s wr, 364 op/s 2024-09-21T07:54:41.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 160715 20.49 MB/sec execute 298 sec latency 113.432 ms 2024-09-21T07:54:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:42 smithi123 ceph-mon[34166]: pgmap v940: 97 pgs: 97 active+clean; 505 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 297 op/s 2024-09-21T07:54:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:42 smithi060 ceph-mon[31244]: pgmap v940: 97 pgs: 97 active+clean; 505 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 297 op/s 2024-09-21T07:54:42.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 161159 20.53 MB/sec execute 299 sec latency 72.185 ms 2024-09-21T07:54:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:42 smithi187 ceph-mon[34367]: pgmap v940: 97 pgs: 97 active+clean; 505 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 297 op/s 2024-09-21T07:54:43.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 161455 20.52 MB/sec execute 300 sec latency 132.779 ms 2024-09-21T07:54:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:44 smithi123 ceph-mon[34166]: pgmap v941: 97 pgs: 97 active+clean; 497 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 346 op/s 2024-09-21T07:54:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:44 smithi060 ceph-mon[31244]: pgmap v941: 97 pgs: 97 active+clean; 497 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 346 op/s 2024-09-21T07:54:44.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 161799 20.53 MB/sec execute 301 sec latency 85.962 ms 2024-09-21T07:54:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:44 smithi187 ceph-mon[34367]: pgmap v941: 97 pgs: 97 active+clean; 497 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 346 op/s 2024-09-21T07:54:45.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 162096 20.50 MB/sec execute 302 sec latency 126.273 ms 2024-09-21T07:54:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:46 smithi123 ceph-mon[34166]: pgmap v942: 97 pgs: 97 active+clean; 502 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 325 op/s 2024-09-21T07:54:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:46 smithi060 ceph-mon[31244]: pgmap v942: 97 pgs: 97 active+clean; 502 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 325 op/s 2024-09-21T07:54:46.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 162368 20.47 MB/sec execute 303 sec latency 98.177 ms 2024-09-21T07:54:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:46 smithi187 ceph-mon[34367]: pgmap v942: 97 pgs: 97 active+clean; 502 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 325 op/s 2024-09-21T07:54:47.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 162668 20.45 MB/sec execute 304 sec latency 434.414 ms 2024-09-21T07:54:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:48 smithi123 ceph-mon[34166]: pgmap v943: 97 pgs: 97 active+clean; 499 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.2 MiB/s wr, 346 op/s 2024-09-21T07:54:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:48 smithi060 ceph-mon[31244]: pgmap v943: 97 pgs: 97 active+clean; 499 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.2 MiB/s wr, 346 op/s 2024-09-21T07:54:48.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 163106 20.43 MB/sec execute 305 sec latency 131.302 ms 2024-09-21T07:54:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:48 smithi187 ceph-mon[34367]: pgmap v943: 97 pgs: 97 active+clean; 499 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.2 MiB/s wr, 346 op/s 2024-09-21T07:54:49.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 163563 20.44 MB/sec execute 306 sec latency 76.369 ms 2024-09-21T07:54:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:50 smithi123 ceph-mon[34166]: pgmap v944: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 357 op/s 2024-09-21T07:54:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:50 smithi060 ceph-mon[31244]: pgmap v944: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 357 op/s 2024-09-21T07:54:50.390 INFO:tasks.workunit.client.0.smithi060.stdout: 10 164113 20.48 MB/sec execute 307 sec latency 66.902 ms 2024-09-21T07:54:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:50 smithi187 ceph-mon[34367]: pgmap v944: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 357 op/s 2024-09-21T07:54:51.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 164509 20.52 MB/sec execute 308 sec latency 210.707 ms 2024-09-21T07:54:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:52 smithi123 ceph-mon[34166]: pgmap v945: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 276 op/s 2024-09-21T07:54:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:52 smithi060 ceph-mon[31244]: pgmap v945: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 276 op/s 2024-09-21T07:54:52.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 164850 20.51 MB/sec execute 309 sec latency 217.545 ms 2024-09-21T07:54:52.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:52 smithi187 ceph-mon[34367]: pgmap v945: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 276 op/s 2024-09-21T07:54:53.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 165106 20.50 MB/sec execute 310 sec latency 75.746 ms 2024-09-21T07:54:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:54 smithi123 ceph-mon[34166]: pgmap v946: 97 pgs: 97 active+clean; 490 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 319 op/s 2024-09-21T07:54:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:54 smithi060 ceph-mon[31244]: pgmap v946: 97 pgs: 97 active+clean; 490 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 319 op/s 2024-09-21T07:54:54.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 165387 20.49 MB/sec execute 311 sec latency 114.699 ms 2024-09-21T07:54:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:54 smithi187 ceph-mon[34367]: pgmap v946: 97 pgs: 97 active+clean; 490 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 319 op/s 2024-09-21T07:54:55.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 165710 20.46 MB/sec execute 312 sec latency 120.931 ms 2024-09-21T07:54:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:56 smithi123 ceph-mon[34166]: pgmap v947: 97 pgs: 97 active+clean; 494 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 323 op/s 2024-09-21T07:54:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:56 smithi060 ceph-mon[31244]: pgmap v947: 97 pgs: 97 active+clean; 494 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 323 op/s 2024-09-21T07:54:56.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 165991 20.44 MB/sec execute 313 sec latency 86.007 ms 2024-09-21T07:54:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:56 smithi187 ceph-mon[34367]: pgmap v947: 97 pgs: 97 active+clean; 494 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 323 op/s 2024-09-21T07:54:57.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 166361 20.41 MB/sec execute 314 sec latency 169.585 ms 2024-09-21T07:54:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:54:58 smithi060 ceph-mon[31244]: pgmap v948: 97 pgs: 97 active+clean; 492 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 309 op/s 2024-09-21T07:54:58.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 166814 20.44 MB/sec execute 315 sec latency 90.567 ms 2024-09-21T07:54:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:54:58 smithi187 ceph-mon[34367]: pgmap v948: 97 pgs: 97 active+clean; 492 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 309 op/s 2024-09-21T07:54:58.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:54:58 smithi123 ceph-mon[34166]: pgmap v948: 97 pgs: 97 active+clean; 492 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 309 op/s 2024-09-21T07:54:59.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 167355 20.45 MB/sec execute 316 sec latency 73.136 ms 2024-09-21T07:55:00.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:00 smithi060 ceph-mon[31244]: pgmap v949: 97 pgs: 97 active+clean; 497 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.3 MiB/s wr, 325 op/s 2024-09-21T07:55:00.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 167857 20.49 MB/sec execute 317 sec latency 46.484 ms 2024-09-21T07:55:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:00 smithi187 ceph-mon[34367]: pgmap v949: 97 pgs: 97 active+clean; 497 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.3 MiB/s wr, 325 op/s 2024-09-21T07:55:00.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:00 smithi123 ceph-mon[34166]: pgmap v949: 97 pgs: 97 active+clean; 497 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.3 MiB/s wr, 325 op/s 2024-09-21T07:55:01.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 168338 20.52 MB/sec execute 318 sec latency 66.286 ms 2024-09-21T07:55:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:02 smithi060 ceph-mon[31244]: pgmap v950: 97 pgs: 97 active+clean; 498 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 278 op/s 2024-09-21T07:55:02.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 168569 20.51 MB/sec execute 319 sec latency 207.660 ms 2024-09-21T07:55:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:02 smithi187 ceph-mon[34367]: pgmap v950: 97 pgs: 97 active+clean; 498 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 278 op/s 2024-09-21T07:55:02.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:02 smithi123 ceph-mon[34166]: pgmap v950: 97 pgs: 97 active+clean; 498 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 278 op/s 2024-09-21T07:55:03.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 168854 20.51 MB/sec execute 320 sec latency 65.859 ms 2024-09-21T07:55:04.374 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:04 smithi060 ceph-mon[31244]: pgmap v951: 97 pgs: 97 active+clean; 502 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 383 op/s 2024-09-21T07:55:04.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 169130 20.46 MB/sec execute 321 sec latency 116.171 ms 2024-09-21T07:55:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:04 smithi187 ceph-mon[34367]: pgmap v951: 97 pgs: 97 active+clean; 502 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 383 op/s 2024-09-21T07:55:04.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:04 smithi123 ceph-mon[34166]: pgmap v951: 97 pgs: 97 active+clean; 502 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 383 op/s 2024-09-21T07:55:05.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 169451 20.45 MB/sec execute 322 sec latency 92.297 ms 2024-09-21T07:55:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:06 smithi060 ceph-mon[31244]: pgmap v952: 97 pgs: 97 active+clean; 502 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 326 op/s 2024-09-21T07:55:06.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 169810 20.43 MB/sec execute 323 sec latency 122.133 ms 2024-09-21T07:55:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:06 smithi187 ceph-mon[34367]: pgmap v952: 97 pgs: 97 active+clean; 502 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 326 op/s 2024-09-21T07:55:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:06 smithi123 ceph-mon[34166]: pgmap v952: 97 pgs: 97 active+clean; 502 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 326 op/s 2024-09-21T07:55:07.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 170196 20.42 MB/sec execute 324 sec latency 230.952 ms 2024-09-21T07:55:08.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:08 smithi060 ceph-mon[31244]: pgmap v953: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.7 MiB/s wr, 306 op/s 2024-09-21T07:55:08.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 170624 20.44 MB/sec execute 325 sec latency 104.986 ms 2024-09-21T07:55:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:08 smithi187 ceph-mon[34367]: pgmap v953: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.7 MiB/s wr, 306 op/s 2024-09-21T07:55:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:08 smithi123 ceph-mon[34166]: pgmap v953: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.7 MiB/s wr, 306 op/s 2024-09-21T07:55:09.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 171157 20.44 MB/sec execute 326 sec latency 115.099 ms 2024-09-21T07:55:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:10 smithi060 ceph-mon[31244]: pgmap v954: 97 pgs: 97 active+clean; 482 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-09-21T07:55:10.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 171587 20.48 MB/sec execute 327 sec latency 43.973 ms 2024-09-21T07:55:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:10 smithi187 ceph-mon[34367]: pgmap v954: 97 pgs: 97 active+clean; 482 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-09-21T07:55:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:10 smithi123 ceph-mon[34166]: pgmap v954: 97 pgs: 97 active+clean; 482 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 386 op/s 2024-09-21T07:55:11.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 172022 20.51 MB/sec execute 328 sec latency 61.812 ms 2024-09-21T07:55:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:12 smithi060 ceph-mon[31244]: pgmap v955: 97 pgs: 97 active+clean; 483 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 311 op/s 2024-09-21T07:55:12.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 172245 20.49 MB/sec execute 329 sec latency 233.066 ms 2024-09-21T07:55:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:12 smithi187 ceph-mon[34367]: pgmap v955: 97 pgs: 97 active+clean; 483 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 311 op/s 2024-09-21T07:55:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:12 smithi123 ceph-mon[34166]: pgmap v955: 97 pgs: 97 active+clean; 483 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 311 op/s 2024-09-21T07:55:13.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 172456 20.46 MB/sec execute 330 sec latency 193.697 ms 2024-09-21T07:55:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:14 smithi060 ceph-mon[31244]: pgmap v956: 97 pgs: 97 active+clean; 489 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.9 MiB/s wr, 373 op/s 2024-09-21T07:55:14.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 172786 20.45 MB/sec execute 331 sec latency 91.524 ms 2024-09-21T07:55:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:14 smithi187 ceph-mon[34367]: pgmap v956: 97 pgs: 97 active+clean; 489 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.9 MiB/s wr, 373 op/s 2024-09-21T07:55:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:14 smithi123 ceph-mon[34166]: pgmap v956: 97 pgs: 97 active+clean; 489 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.9 MiB/s wr, 373 op/s 2024-09-21T07:55:15.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 173132 20.42 MB/sec execute 332 sec latency 86.268 ms 2024-09-21T07:55:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:16 smithi060 ceph-mon[31244]: pgmap v957: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:55:16.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 173615 20.42 MB/sec execute 333 sec latency 73.573 ms 2024-09-21T07:55:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:16 smithi187 ceph-mon[34367]: pgmap v957: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:55:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:16 smithi123 ceph-mon[34166]: pgmap v957: 97 pgs: 97 active+clean; 491 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 311 op/s 2024-09-21T07:55:17.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 174041 20.44 MB/sec execute 334 sec latency 143.074 ms 2024-09-21T07:55:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:18 smithi060 ceph-mon[31244]: pgmap v958: 97 pgs: 97 active+clean; 490 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 336 op/s 2024-09-21T07:55:18.391 INFO:tasks.workunit.client.0.smithi060.stdout: 10 174629 20.46 MB/sec execute 335 sec latency 72.177 ms 2024-09-21T07:55:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:18 smithi187 ceph-mon[34367]: pgmap v958: 97 pgs: 97 active+clean; 490 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 336 op/s 2024-09-21T07:55:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:18 smithi123 ceph-mon[34166]: pgmap v958: 97 pgs: 97 active+clean; 490 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 336 op/s 2024-09-21T07:55:19.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 175056 20.48 MB/sec execute 336 sec latency 62.186 ms 2024-09-21T07:55:20.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 175447 20.51 MB/sec execute 337 sec latency 73.702 ms 2024-09-21T07:55:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:20 smithi187 ceph-mon[34367]: pgmap v959: 97 pgs: 97 active+clean; 494 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.5 MiB/s wr, 414 op/s 2024-09-21T07:55:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:20 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:20 smithi123 ceph-mon[34166]: pgmap v959: 97 pgs: 97 active+clean; 494 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.5 MiB/s wr, 414 op/s 2024-09-21T07:55:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:20 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:20 smithi060 ceph-mon[31244]: pgmap v959: 97 pgs: 97 active+clean; 494 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.5 MiB/s wr, 414 op/s 2024-09-21T07:55:20.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:20 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:55:21.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 175723 20.50 MB/sec execute 338 sec latency 74.004 ms 2024-09-21T07:55:22.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 175881 20.47 MB/sec execute 339 sec latency 285.529 ms 2024-09-21T07:55:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: pgmap v960: 97 pgs: 97 active+clean; 495 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 302 op/s 2024-09-21T07:55:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.770 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:22 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: pgmap v960: 97 pgs: 97 active+clean; 495 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 302 op/s 2024-09-21T07:55:22.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:22 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: pgmap v960: 97 pgs: 97 active+clean; 495 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 302 op/s 2024-09-21T07:55:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:22.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:22 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:23.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 176119 20.43 MB/sec execute 340 sec latency 289.024 ms 2024-09-21T07:55:23.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:23.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:23.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:23.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:23.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:23.849 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:23.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:55:23.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:55:23.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:55:24.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 176426 20.43 MB/sec execute 341 sec latency 64.995 ms 2024-09-21T07:55:24.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:24 smithi187 ceph-mon[34367]: pgmap v961: 97 pgs: 97 active+clean; 503 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.4 MiB/s wr, 387 op/s 2024-09-21T07:55:24.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:24 smithi123 ceph-mon[34166]: pgmap v961: 97 pgs: 97 active+clean; 503 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.4 MiB/s wr, 387 op/s 2024-09-21T07:55:24.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:24 smithi060 ceph-mon[31244]: pgmap v961: 97 pgs: 97 active+clean; 503 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.4 MiB/s wr, 387 op/s 2024-09-21T07:55:25.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 176842 20.39 MB/sec execute 342 sec latency 101.446 ms 2024-09-21T07:55:26.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 177274 20.40 MB/sec execute 343 sec latency 62.262 ms 2024-09-21T07:55:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:26 smithi187 ceph-mon[34367]: pgmap v962: 97 pgs: 97 active+clean; 505 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 335 op/s 2024-09-21T07:55:26.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:26 smithi123 ceph-mon[34166]: pgmap v962: 97 pgs: 97 active+clean; 505 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 335 op/s 2024-09-21T07:55:26.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:26 smithi060 ceph-mon[31244]: pgmap v962: 97 pgs: 97 active+clean; 505 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.4 MiB/s wr, 335 op/s 2024-09-21T07:55:27.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 177690 20.42 MB/sec execute 344 sec latency 249.322 ms 2024-09-21T07:55:28.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 178230 20.44 MB/sec execute 345 sec latency 152.881 ms 2024-09-21T07:55:28.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:28 smithi187 ceph-mon[34367]: pgmap v963: 97 pgs: 97 active+clean; 506 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-09-21T07:55:28.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:28 smithi123 ceph-mon[34166]: pgmap v963: 97 pgs: 97 active+clean; 506 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-09-21T07:55:28.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:28 smithi060 ceph-mon[31244]: pgmap v963: 97 pgs: 97 active+clean; 506 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-09-21T07:55:29.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 178649 20.46 MB/sec execute 346 sec latency 68.210 ms 2024-09-21T07:55:30.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 179069 20.48 MB/sec execute 347 sec latency 53.674 ms 2024-09-21T07:55:30.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:30 smithi187 ceph-mon[34367]: pgmap v964: 97 pgs: 97 active+clean; 481 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.3 MiB/s wr, 400 op/s 2024-09-21T07:55:30.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:30 smithi123 ceph-mon[34166]: pgmap v964: 97 pgs: 97 active+clean; 481 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.3 MiB/s wr, 400 op/s 2024-09-21T07:55:30.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:30 smithi060 ceph-mon[31244]: pgmap v964: 97 pgs: 97 active+clean; 481 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.3 MiB/s wr, 400 op/s 2024-09-21T07:55:31.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 179378 20.48 MB/sec execute 348 sec latency 79.048 ms 2024-09-21T07:55:32.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 179656 20.45 MB/sec execute 349 sec latency 85.328 ms 2024-09-21T07:55:32.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:32 smithi123 ceph-mon[34166]: pgmap v965: 97 pgs: 97 active+clean; 481 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-09-21T07:55:32.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:32 smithi060 ceph-mon[31244]: pgmap v965: 97 pgs: 97 active+clean; 481 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-09-21T07:55:33.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:32 smithi187 ceph-mon[34367]: pgmap v965: 97 pgs: 97 active+clean; 481 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.9 MiB/s wr, 293 op/s 2024-09-21T07:55:33.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 179885 20.42 MB/sec execute 350 sec latency 245.409 ms 2024-09-21T07:55:34.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 180189 20.40 MB/sec execute 351 sec latency 132.393 ms 2024-09-21T07:55:34.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:34 smithi123 ceph-mon[34166]: pgmap v966: 97 pgs: 97 active+clean; 485 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-09-21T07:55:34.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:34 smithi060 ceph-mon[31244]: pgmap v966: 97 pgs: 97 active+clean; 485 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-09-21T07:55:35.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:34 smithi187 ceph-mon[34367]: pgmap v966: 97 pgs: 97 active+clean; 485 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-09-21T07:55:35.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 180678 20.39 MB/sec execute 352 sec latency 63.198 ms 2024-09-21T07:55:36.392 INFO:tasks.workunit.client.0.smithi060.stdout: 10 181235 20.43 MB/sec execute 353 sec latency 57.428 ms 2024-09-21T07:55:36.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:36 smithi123 ceph-mon[34166]: pgmap v967: 97 pgs: 97 active+clean; 491 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 317 op/s 2024-09-21T07:55:36.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:36 smithi060 ceph-mon[31244]: pgmap v967: 97 pgs: 97 active+clean; 491 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 317 op/s 2024-09-21T07:55:37.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:36 smithi187 ceph-mon[34367]: pgmap v967: 97 pgs: 97 active+clean; 491 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 4.7 MiB/s wr, 317 op/s 2024-09-21T07:55:37.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 181779 20.46 MB/sec execute 354 sec latency 111.685 ms 2024-09-21T07:55:38.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 182172 20.48 MB/sec execute 355 sec latency 161.995 ms 2024-09-21T07:55:38.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:38 smithi123 ceph-mon[34166]: pgmap v968: 97 pgs: 97 active+clean; 491 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-21T07:55:38.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:38 smithi060 ceph-mon[31244]: pgmap v968: 97 pgs: 97 active+clean; 491 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-21T07:55:39.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:38 smithi187 ceph-mon[34367]: pgmap v968: 97 pgs: 97 active+clean; 491 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-21T07:55:39.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 182579 20.51 MB/sec execute 356 sec latency 67.951 ms 2024-09-21T07:55:40.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 182823 20.47 MB/sec execute 357 sec latency 126.921 ms 2024-09-21T07:55:40.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:40 smithi123 ceph-mon[34166]: pgmap v969: 97 pgs: 97 active+clean; 495 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-09-21T07:55:40.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:40 smithi060 ceph-mon[31244]: pgmap v969: 97 pgs: 97 active+clean; 495 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-09-21T07:55:41.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:40 smithi187 ceph-mon[34367]: pgmap v969: 97 pgs: 97 active+clean; 495 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 342 op/s 2024-09-21T07:55:41.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 183081 20.46 MB/sec execute 358 sec latency 93.910 ms 2024-09-21T07:55:42.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 183343 20.43 MB/sec execute 359 sec latency 136.323 ms 2024-09-21T07:55:42.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:42 smithi123 ceph-mon[34166]: pgmap v970: 97 pgs: 97 active+clean; 495 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 275 op/s 2024-09-21T07:55:42.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:42 smithi060 ceph-mon[31244]: pgmap v970: 97 pgs: 97 active+clean; 495 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 275 op/s 2024-09-21T07:55:43.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:42 smithi187 ceph-mon[34367]: pgmap v970: 97 pgs: 97 active+clean; 495 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 275 op/s 2024-09-21T07:55:43.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 183555 20.41 MB/sec execute 360 sec latency 275.590 ms 2024-09-21T07:55:44.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 183890 20.38 MB/sec execute 361 sec latency 99.199 ms 2024-09-21T07:55:44.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:44 smithi123 ceph-mon[34166]: pgmap v971: 97 pgs: 97 active+clean; 502 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 363 op/s 2024-09-21T07:55:44.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:44 smithi060 ceph-mon[31244]: pgmap v971: 97 pgs: 97 active+clean; 502 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 363 op/s 2024-09-21T07:55:45.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:44 smithi187 ceph-mon[34367]: pgmap v971: 97 pgs: 97 active+clean; 502 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 363 op/s 2024-09-21T07:55:45.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 184295 20.38 MB/sec execute 362 sec latency 74.028 ms 2024-09-21T07:55:46.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 184767 20.39 MB/sec execute 363 sec latency 77.874 ms 2024-09-21T07:55:46.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:46 smithi123 ceph-mon[34166]: pgmap v972: 97 pgs: 97 active+clean; 503 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 305 op/s 2024-09-21T07:55:46.872 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:46 smithi060 ceph-mon[31244]: pgmap v972: 97 pgs: 97 active+clean; 503 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 305 op/s 2024-09-21T07:55:47.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:46 smithi187 ceph-mon[34367]: pgmap v972: 97 pgs: 97 active+clean; 503 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 305 op/s 2024-09-21T07:55:47.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 185264 20.41 MB/sec execute 364 sec latency 70.959 ms 2024-09-21T07:55:48.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 185657 20.43 MB/sec execute 365 sec latency 259.344 ms 2024-09-21T07:55:48.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:48 smithi123 ceph-mon[34166]: pgmap v973: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.9 MiB/s wr, 361 op/s 2024-09-21T07:55:48.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:48 smithi060 ceph-mon[31244]: pgmap v973: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.9 MiB/s wr, 361 op/s 2024-09-21T07:55:49.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:48 smithi187 ceph-mon[34367]: pgmap v973: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.9 MiB/s wr, 361 op/s 2024-09-21T07:55:49.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 185915 20.42 MB/sec execute 366 sec latency 274.657 ms 2024-09-21T07:55:50.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 186234 20.42 MB/sec execute 367 sec latency 94.325 ms 2024-09-21T07:55:50.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:50 smithi123 ceph-mon[34166]: pgmap v974: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 372 op/s 2024-09-21T07:55:50.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:50 smithi060 ceph-mon[31244]: pgmap v974: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 372 op/s 2024-09-21T07:55:51.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:50 smithi187 ceph-mon[34367]: pgmap v974: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 372 op/s 2024-09-21T07:55:51.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 186479 20.40 MB/sec execute 368 sec latency 87.629 ms 2024-09-21T07:55:52.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 186786 20.38 MB/sec execute 369 sec latency 69.602 ms 2024-09-21T07:55:52.820 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:52 smithi187 ceph-mon[34367]: pgmap v975: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.6 MiB/s wr, 304 op/s 2024-09-21T07:55:52.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:52 smithi123 ceph-mon[34166]: pgmap v975: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.6 MiB/s wr, 304 op/s 2024-09-21T07:55:52.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:52 smithi060 ceph-mon[31244]: pgmap v975: 97 pgs: 97 active+clean; 508 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.6 MiB/s wr, 304 op/s 2024-09-21T07:55:53.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 187023 20.37 MB/sec execute 370 sec latency 225.812 ms 2024-09-21T07:55:54.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 187384 20.34 MB/sec execute 371 sec latency 77.344 ms 2024-09-21T07:55:54.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:54 smithi123 ceph-mon[34166]: pgmap v976: 97 pgs: 97 active+clean; 496 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 357 op/s 2024-09-21T07:55:54.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:54 smithi060 ceph-mon[31244]: pgmap v976: 97 pgs: 97 active+clean; 496 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 357 op/s 2024-09-21T07:55:55.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:54 smithi187 ceph-mon[34367]: pgmap v976: 97 pgs: 97 active+clean; 496 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 357 op/s 2024-09-21T07:55:55.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 187833 20.33 MB/sec execute 372 sec latency 58.379 ms 2024-09-21T07:55:55.848 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:55 smithi123 ceph-mon[34166]: pgmap v977: 97 pgs: 97 active+clean; 490 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 301 op/s 2024-09-21T07:55:55.871 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:55 smithi060 ceph-mon[31244]: pgmap v977: 97 pgs: 97 active+clean; 490 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 301 op/s 2024-09-21T07:55:56.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:55 smithi187 ceph-mon[34367]: pgmap v977: 97 pgs: 97 active+clean; 490 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 301 op/s 2024-09-21T07:55:56.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 188374 20.36 MB/sec execute 373 sec latency 99.266 ms 2024-09-21T07:55:57.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 188693 20.37 MB/sec execute 374 sec latency 404.235 ms 2024-09-21T07:55:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:55:58 smithi123 ceph-mon[34166]: pgmap v978: 97 pgs: 97 active+clean; 493 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.1 MiB/s wr, 350 op/s 2024-09-21T07:55:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:55:58 smithi060 ceph-mon[31244]: pgmap v978: 97 pgs: 97 active+clean; 493 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.1 MiB/s wr, 350 op/s 2024-09-21T07:55:58.393 INFO:tasks.workunit.client.0.smithi060.stdout: 10 189067 20.38 MB/sec execute 375 sec latency 262.522 ms 2024-09-21T07:55:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:55:58 smithi187 ceph-mon[34367]: pgmap v978: 97 pgs: 97 active+clean; 493 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 6.1 MiB/s wr, 350 op/s 2024-09-21T07:55:59.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 189453 20.38 MB/sec execute 376 sec latency 58.933 ms 2024-09-21T07:56:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:00 smithi123 ceph-mon[34166]: pgmap v979: 97 pgs: 97 active+clean; 494 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 327 op/s 2024-09-21T07:56:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:00 smithi060 ceph-mon[31244]: pgmap v979: 97 pgs: 97 active+clean; 494 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 327 op/s 2024-09-21T07:56:00.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 189812 20.39 MB/sec execute 377 sec latency 56.232 ms 2024-09-21T07:56:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:00 smithi187 ceph-mon[34367]: pgmap v979: 97 pgs: 97 active+clean; 494 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.6 MiB/s wr, 327 op/s 2024-09-21T07:56:01.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 190100 20.38 MB/sec execute 378 sec latency 134.524 ms 2024-09-21T07:56:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:02 smithi123 ceph-mon[34166]: pgmap v980: 97 pgs: 97 active+clean; 494 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 265 op/s 2024-09-21T07:56:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:02 smithi060 ceph-mon[31244]: pgmap v980: 97 pgs: 97 active+clean; 494 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 265 op/s 2024-09-21T07:56:02.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 190428 20.36 MB/sec execute 379 sec latency 68.146 ms 2024-09-21T07:56:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:02 smithi187 ceph-mon[34367]: pgmap v980: 97 pgs: 97 active+clean; 494 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 265 op/s 2024-09-21T07:56:03.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 190700 20.34 MB/sec execute 380 sec latency 136.808 ms 2024-09-21T07:56:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:04 smithi123 ceph-mon[34166]: pgmap v981: 97 pgs: 97 active+clean; 501 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2024-09-21T07:56:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:04 smithi060 ceph-mon[31244]: pgmap v981: 97 pgs: 97 active+clean; 501 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2024-09-21T07:56:04.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 191146 20.33 MB/sec execute 381 sec latency 65.747 ms 2024-09-21T07:56:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:04 smithi187 ceph-mon[34367]: pgmap v981: 97 pgs: 97 active+clean; 501 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2024-09-21T07:56:05.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 191594 20.35 MB/sec execute 382 sec latency 64.958 ms 2024-09-21T07:56:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:06 smithi123 ceph-mon[34166]: pgmap v982: 97 pgs: 97 active+clean; 504 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2024-09-21T07:56:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:06 smithi060 ceph-mon[31244]: pgmap v982: 97 pgs: 97 active+clean; 504 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2024-09-21T07:56:06.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 192171 20.37 MB/sec execute 383 sec latency 83.635 ms 2024-09-21T07:56:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:06 smithi187 ceph-mon[34367]: pgmap v982: 97 pgs: 97 active+clean; 504 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 323 op/s 2024-09-21T07:56:07.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 192662 20.42 MB/sec execute 384 sec latency 54.432 ms 2024-09-21T07:56:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:08 smithi123 ceph-mon[34166]: pgmap v983: 97 pgs: 97 active+clean; 504 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.6 MiB/s wr, 333 op/s 2024-09-21T07:56:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:08 smithi060 ceph-mon[31244]: pgmap v983: 97 pgs: 97 active+clean; 504 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.6 MiB/s wr, 333 op/s 2024-09-21T07:56:08.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 193023 20.40 MB/sec execute 385 sec latency 199.207 ms 2024-09-21T07:56:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:08 smithi187 ceph-mon[34367]: pgmap v983: 97 pgs: 97 active+clean; 504 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.6 MiB/s wr, 333 op/s 2024-09-21T07:56:09.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 193287 20.40 MB/sec execute 386 sec latency 256.502 ms 2024-09-21T07:56:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:10 smithi123 ceph-mon[34166]: pgmap v984: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 354 op/s 2024-09-21T07:56:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:10 smithi060 ceph-mon[31244]: pgmap v984: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 354 op/s 2024-09-21T07:56:10.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 193576 20.38 MB/sec execute 387 sec latency 80.790 ms 2024-09-21T07:56:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:10 smithi187 ceph-mon[34367]: pgmap v984: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 354 op/s 2024-09-21T07:56:11.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 193930 20.38 MB/sec execute 388 sec latency 151.862 ms 2024-09-21T07:56:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:12 smithi123 ceph-mon[34166]: pgmap v985: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.5 MiB/s wr, 285 op/s 2024-09-21T07:56:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:12 smithi060 ceph-mon[31244]: pgmap v985: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.5 MiB/s wr, 285 op/s 2024-09-21T07:56:12.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 194252 20.36 MB/sec execute 389 sec latency 142.839 ms 2024-09-21T07:56:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:12 smithi187 ceph-mon[34367]: pgmap v985: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.5 MiB/s wr, 285 op/s 2024-09-21T07:56:13.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 194700 20.35 MB/sec execute 390 sec latency 112.773 ms 2024-09-21T07:56:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:14 smithi123 ceph-mon[34166]: pgmap v986: 97 pgs: 97 active+clean; 497 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.0 MiB/s wr, 395 op/s 2024-09-21T07:56:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:14 smithi060 ceph-mon[31244]: pgmap v986: 97 pgs: 97 active+clean; 497 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.0 MiB/s wr, 395 op/s 2024-09-21T07:56:14.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 195078 20.37 MB/sec execute 391 sec latency 164.376 ms 2024-09-21T07:56:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:14 smithi187 ceph-mon[34367]: pgmap v986: 97 pgs: 97 active+clean; 497 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.0 MiB/s wr, 395 op/s 2024-09-21T07:56:15.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 195620 20.37 MB/sec execute 392 sec latency 108.491 ms 2024-09-21T07:56:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:16 smithi123 ceph-mon[34166]: pgmap v987: 97 pgs: 97 active+clean; 485 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 313 op/s 2024-09-21T07:56:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:16 smithi060 ceph-mon[31244]: pgmap v987: 97 pgs: 97 active+clean; 485 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 313 op/s 2024-09-21T07:56:16.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 196035 20.40 MB/sec execute 393 sec latency 54.985 ms 2024-09-21T07:56:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:16 smithi187 ceph-mon[34367]: pgmap v987: 97 pgs: 97 active+clean; 485 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 313 op/s 2024-09-21T07:56:17.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 196510 20.41 MB/sec execute 394 sec latency 66.575 ms 2024-09-21T07:56:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:18 smithi123 ceph-mon[34166]: pgmap v988: 97 pgs: 97 active+clean; 489 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 371 op/s 2024-09-21T07:56:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:18 smithi060 ceph-mon[31244]: pgmap v988: 97 pgs: 97 active+clean; 489 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 371 op/s 2024-09-21T07:56:18.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 196871 20.42 MB/sec execute 395 sec latency 90.400 ms 2024-09-21T07:56:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:18 smithi187 ceph-mon[34367]: pgmap v988: 97 pgs: 97 active+clean; 489 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 371 op/s 2024-09-21T07:56:19.394 INFO:tasks.workunit.client.0.smithi060.stdout: 10 197023 20.39 MB/sec execute 396 sec latency 317.694 ms 2024-09-21T07:56:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:20 smithi123 ceph-mon[34166]: pgmap v989: 97 pgs: 97 active+clean; 490 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 366 op/s 2024-09-21T07:56:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:20 smithi060 ceph-mon[31244]: pgmap v989: 97 pgs: 97 active+clean; 490 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 366 op/s 2024-09-21T07:56:20.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 197311 20.38 MB/sec execute 397 sec latency 113.156 ms 2024-09-21T07:56:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:20 smithi187 ceph-mon[34367]: pgmap v989: 97 pgs: 97 active+clean; 490 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 366 op/s 2024-09-21T07:56:21.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 197631 20.38 MB/sec execute 398 sec latency 110.131 ms 2024-09-21T07:56:22.320 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:22 smithi187 ceph-mon[34367]: pgmap v990: 97 pgs: 97 active+clean; 492 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-09-21T07:56:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:22 smithi123 ceph-mon[34166]: pgmap v990: 97 pgs: 97 active+clean; 492 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-09-21T07:56:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:22 smithi060 ceph-mon[31244]: pgmap v990: 97 pgs: 97 active+clean; 492 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-09-21T07:56:22.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 198053 20.35 MB/sec execute 399 sec latency 126.287 ms 2024-09-21T07:56:23.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:23.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:23 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:23 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 198447 20.35 MB/sec execute 400 sec latency 133.293 ms 2024-09-21T07:56:23.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:56:23.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.522 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.523 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:23.523 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:23 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: pgmap v991: 97 pgs: 97 active+clean; 495 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 370 op/s 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: pgmap v991: 97 pgs: 97 active+clean; 495 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 370 op/s 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:24.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 198840 20.35 MB/sec execute 401 sec latency 133.335 ms 2024-09-21T07:56:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: pgmap v991: 97 pgs: 97 active+clean; 495 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 370 op/s 2024-09-21T07:56:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:56:24.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:56:25.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 199342 20.38 MB/sec execute 402 sec latency 80.304 ms 2024-09-21T07:56:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:26 smithi123 ceph-mon[34166]: pgmap v992: 97 pgs: 97 active+clean; 495 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2024-09-21T07:56:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:26 smithi060 ceph-mon[31244]: pgmap v992: 97 pgs: 97 active+clean; 495 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2024-09-21T07:56:26.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 199796 20.40 MB/sec execute 403 sec latency 58.617 ms 2024-09-21T07:56:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:26 smithi187 ceph-mon[34367]: pgmap v992: 97 pgs: 97 active+clean; 495 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 286 op/s 2024-09-21T07:56:27.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 200220 20.41 MB/sec execute 404 sec latency 69.431 ms 2024-09-21T07:56:28.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:28 smithi123 ceph-mon[34166]: pgmap v993: 97 pgs: 97 active+clean; 501 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 362 op/s 2024-09-21T07:56:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:28 smithi060 ceph-mon[31244]: pgmap v993: 97 pgs: 97 active+clean; 501 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 362 op/s 2024-09-21T07:56:28.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 200507 20.40 MB/sec execute 405 sec latency 70.632 ms 2024-09-21T07:56:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:28 smithi187 ceph-mon[34367]: pgmap v993: 97 pgs: 97 active+clean; 501 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 362 op/s 2024-09-21T07:56:29.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 200725 20.37 MB/sec execute 406 sec latency 358.313 ms 2024-09-21T07:56:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:30 smithi123 ceph-mon[34166]: pgmap v994: 97 pgs: 97 active+clean; 501 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.1 MiB/s wr, 312 op/s 2024-09-21T07:56:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:30 smithi060 ceph-mon[31244]: pgmap v994: 97 pgs: 97 active+clean; 501 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.1 MiB/s wr, 312 op/s 2024-09-21T07:56:30.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 200998 20.36 MB/sec execute 407 sec latency 107.863 ms 2024-09-21T07:56:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:30 smithi187 ceph-mon[34367]: pgmap v994: 97 pgs: 97 active+clean; 501 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.1 MiB/s wr, 312 op/s 2024-09-21T07:56:31.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 201324 20.35 MB/sec execute 408 sec latency 244.984 ms 2024-09-21T07:56:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:32 smithi123 ceph-mon[34166]: pgmap v995: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 312 op/s 2024-09-21T07:56:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:32 smithi060 ceph-mon[31244]: pgmap v995: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 312 op/s 2024-09-21T07:56:32.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 201821 20.35 MB/sec execute 409 sec latency 245.441 ms 2024-09-21T07:56:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:32 smithi187 ceph-mon[34367]: pgmap v995: 97 pgs: 97 active+clean; 506 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 312 op/s 2024-09-21T07:56:33.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 202326 20.37 MB/sec execute 410 sec latency 83.018 ms 2024-09-21T07:56:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:34 smithi123 ceph-mon[34166]: pgmap v996: 97 pgs: 97 active+clean; 492 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.2 MiB/s wr, 387 op/s 2024-09-21T07:56:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:34 smithi060 ceph-mon[31244]: pgmap v996: 97 pgs: 97 active+clean; 492 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.2 MiB/s wr, 387 op/s 2024-09-21T07:56:34.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 202787 20.38 MB/sec execute 411 sec latency 224.622 ms 2024-09-21T07:56:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:34 smithi187 ceph-mon[34367]: pgmap v996: 97 pgs: 97 active+clean; 492 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.2 MiB/s wr, 387 op/s 2024-09-21T07:56:35.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 203179 20.40 MB/sec execute 412 sec latency 66.091 ms 2024-09-21T07:56:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:36 smithi123 ceph-mon[34166]: pgmap v997: 97 pgs: 97 active+clean; 485 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 332 op/s 2024-09-21T07:56:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:36 smithi060 ceph-mon[31244]: pgmap v997: 97 pgs: 97 active+clean; 485 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 332 op/s 2024-09-21T07:56:36.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 203630 20.41 MB/sec execute 413 sec latency 42.058 ms 2024-09-21T07:56:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:36 smithi187 ceph-mon[34367]: pgmap v997: 97 pgs: 97 active+clean; 485 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 332 op/s 2024-09-21T07:56:37.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 203966 20.41 MB/sec execute 414 sec latency 73.813 ms 2024-09-21T07:56:38.121 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:37 smithi060 ceph-mon[31244]: pgmap v998: 97 pgs: 97 active+clean; 486 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-21T07:56:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:37 smithi187 ceph-mon[34367]: pgmap v998: 97 pgs: 97 active+clean; 486 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-21T07:56:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:37 smithi123 ceph-mon[34166]: pgmap v998: 97 pgs: 97 active+clean; 486 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-09-21T07:56:38.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 204253 20.39 MB/sec execute 415 sec latency 86.430 ms 2024-09-21T07:56:39.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 204456 20.37 MB/sec execute 416 sec latency 245.634 ms 2024-09-21T07:56:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:40 smithi123 ceph-mon[34166]: pgmap v999: 97 pgs: 97 active+clean; 493 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 346 op/s 2024-09-21T07:56:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:40 smithi060 ceph-mon[31244]: pgmap v999: 97 pgs: 97 active+clean; 493 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 346 op/s 2024-09-21T07:56:40.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 204788 20.36 MB/sec execute 417 sec latency 123.517 ms 2024-09-21T07:56:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:40 smithi187 ceph-mon[34367]: pgmap v999: 97 pgs: 97 active+clean; 493 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 346 op/s 2024-09-21T07:56:41.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 205251 20.36 MB/sec execute 418 sec latency 112.112 ms 2024-09-21T07:56:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:42 smithi123 ceph-mon[34166]: pgmap v1000: 97 pgs: 97 active+clean; 493 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 324 op/s 2024-09-21T07:56:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:42 smithi060 ceph-mon[31244]: pgmap v1000: 97 pgs: 97 active+clean; 493 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 324 op/s 2024-09-21T07:56:42.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 205673 20.36 MB/sec execute 419 sec latency 97.717 ms 2024-09-21T07:56:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:42 smithi187 ceph-mon[34367]: pgmap v1000: 97 pgs: 97 active+clean; 493 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 324 op/s 2024-09-21T07:56:43.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 206145 20.36 MB/sec execute 420 sec latency 94.367 ms 2024-09-21T07:56:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:44 smithi123 ceph-mon[34166]: pgmap v1001: 97 pgs: 97 active+clean; 497 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 383 op/s 2024-09-21T07:56:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:44 smithi060 ceph-mon[31244]: pgmap v1001: 97 pgs: 97 active+clean; 497 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 383 op/s 2024-09-21T07:56:44.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 206486 20.38 MB/sec execute 421 sec latency 266.611 ms 2024-09-21T07:56:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:44 smithi187 ceph-mon[34367]: pgmap v1001: 97 pgs: 97 active+clean; 497 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 383 op/s 2024-09-21T07:56:45.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 206923 20.39 MB/sec execute 422 sec latency 77.156 ms 2024-09-21T07:56:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:46 smithi123 ceph-mon[34166]: pgmap v1002: 97 pgs: 97 active+clean; 498 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 321 op/s 2024-09-21T07:56:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:46 smithi060 ceph-mon[31244]: pgmap v1002: 97 pgs: 97 active+clean; 498 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 321 op/s 2024-09-21T07:56:46.395 INFO:tasks.workunit.client.0.smithi060.stdout: 10 207270 20.40 MB/sec execute 423 sec latency 67.685 ms 2024-09-21T07:56:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:46 smithi187 ceph-mon[34367]: pgmap v1002: 97 pgs: 97 active+clean; 498 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 321 op/s 2024-09-21T07:56:47.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 207585 20.38 MB/sec execute 424 sec latency 103.037 ms 2024-09-21T07:56:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:48 smithi123 ceph-mon[34166]: pgmap v1003: 97 pgs: 97 active+clean; 503 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 368 op/s 2024-09-21T07:56:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:48 smithi060 ceph-mon[31244]: pgmap v1003: 97 pgs: 97 active+clean; 503 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 368 op/s 2024-09-21T07:56:48.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 207876 20.37 MB/sec execute 425 sec latency 90.645 ms 2024-09-21T07:56:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:48 smithi187 ceph-mon[34367]: pgmap v1003: 97 pgs: 97 active+clean; 503 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 368 op/s 2024-09-21T07:56:49.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 208113 20.35 MB/sec execute 426 sec latency 236.442 ms 2024-09-21T07:56:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:50 smithi123 ceph-mon[34166]: pgmap v1004: 97 pgs: 97 active+clean; 504 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.6 MiB/s wr, 371 op/s 2024-09-21T07:56:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:50 smithi060 ceph-mon[31244]: pgmap v1004: 97 pgs: 97 active+clean; 504 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.6 MiB/s wr, 371 op/s 2024-09-21T07:56:50.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 208493 20.35 MB/sec execute 427 sec latency 210.374 ms 2024-09-21T07:56:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:50 smithi187 ceph-mon[34367]: pgmap v1004: 97 pgs: 97 active+clean; 504 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.6 MiB/s wr, 371 op/s 2024-09-21T07:56:51.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 208957 20.35 MB/sec execute 428 sec latency 98.026 ms 2024-09-21T07:56:52.320 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:52 smithi187 ceph-mon[34367]: pgmap v1005: 97 pgs: 97 active+clean; 504 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.7 MiB/s wr, 288 op/s 2024-09-21T07:56:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:52 smithi123 ceph-mon[34166]: pgmap v1005: 97 pgs: 97 active+clean; 504 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.7 MiB/s wr, 288 op/s 2024-09-21T07:56:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:52 smithi060 ceph-mon[31244]: pgmap v1005: 97 pgs: 97 active+clean; 504 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.7 MiB/s wr, 288 op/s 2024-09-21T07:56:52.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 209511 20.36 MB/sec execute 429 sec latency 63.108 ms 2024-09-21T07:56:53.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 210013 20.40 MB/sec execute 430 sec latency 59.068 ms 2024-09-21T07:56:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:54 smithi123 ceph-mon[34166]: pgmap v1006: 97 pgs: 97 active+clean; 509 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.4 MiB/s wr, 374 op/s 2024-09-21T07:56:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:54 smithi060 ceph-mon[31244]: pgmap v1006: 97 pgs: 97 active+clean; 509 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.4 MiB/s wr, 374 op/s 2024-09-21T07:56:54.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 210353 20.40 MB/sec execute 431 sec latency 238.103 ms 2024-09-21T07:56:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:54 smithi187 ceph-mon[34367]: pgmap v1006: 97 pgs: 97 active+clean; 509 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.4 MiB/s wr, 374 op/s 2024-09-21T07:56:55.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 210711 20.39 MB/sec execute 432 sec latency 251.260 ms 2024-09-21T07:56:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:56 smithi123 ceph-mon[34166]: pgmap v1007: 97 pgs: 97 active+clean; 510 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 304 op/s 2024-09-21T07:56:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:56 smithi060 ceph-mon[31244]: pgmap v1007: 97 pgs: 97 active+clean; 510 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 304 op/s 2024-09-21T07:56:56.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 211002 20.39 MB/sec execute 433 sec latency 175.164 ms 2024-09-21T07:56:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:56 smithi187 ceph-mon[34367]: pgmap v1007: 97 pgs: 97 active+clean; 510 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 304 op/s 2024-09-21T07:56:57.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 211326 20.37 MB/sec execute 434 sec latency 76.229 ms 2024-09-21T07:56:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:56:58 smithi123 ceph-mon[34166]: pgmap v1008: 97 pgs: 97 active+clean; 495 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 348 op/s 2024-09-21T07:56:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:56:58 smithi060 ceph-mon[31244]: pgmap v1008: 97 pgs: 97 active+clean; 495 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 348 op/s 2024-09-21T07:56:58.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 211627 20.37 MB/sec execute 435 sec latency 87.721 ms 2024-09-21T07:56:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:56:58 smithi187 ceph-mon[34367]: pgmap v1008: 97 pgs: 97 active+clean; 495 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 348 op/s 2024-09-21T07:56:59.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 212062 20.36 MB/sec execute 436 sec latency 82.294 ms 2024-09-21T07:57:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:00 smithi123 ceph-mon[34166]: pgmap v1009: 97 pgs: 97 active+clean; 487 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 322 op/s 2024-09-21T07:57:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:00 smithi060 ceph-mon[31244]: pgmap v1009: 97 pgs: 97 active+clean; 487 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 322 op/s 2024-09-21T07:57:00.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 212343 20.34 MB/sec execute 437 sec latency 202.980 ms 2024-09-21T07:57:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:00 smithi187 ceph-mon[34367]: pgmap v1009: 97 pgs: 97 active+clean; 487 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 322 op/s 2024-09-21T07:57:01.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 212698 20.35 MB/sec execute 438 sec latency 83.993 ms 2024-09-21T07:57:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:02 smithi123 ceph-mon[34166]: pgmap v1010: 97 pgs: 97 active+clean; 487 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 273 op/s 2024-09-21T07:57:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:02 smithi060 ceph-mon[31244]: pgmap v1010: 97 pgs: 97 active+clean; 487 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 273 op/s 2024-09-21T07:57:02.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 213125 20.34 MB/sec execute 439 sec latency 110.532 ms 2024-09-21T07:57:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:02 smithi187 ceph-mon[34367]: pgmap v1010: 97 pgs: 97 active+clean; 487 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 273 op/s 2024-09-21T07:57:03.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 213523 20.36 MB/sec execute 440 sec latency 80.517 ms 2024-09-21T07:57:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:04 smithi123 ceph-mon[34166]: pgmap v1011: 97 pgs: 97 active+clean; 493 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 382 op/s 2024-09-21T07:57:04.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:04 smithi060 ceph-mon[31244]: pgmap v1011: 97 pgs: 97 active+clean; 493 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 382 op/s 2024-09-21T07:57:04.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 214007 20.38 MB/sec execute 441 sec latency 47.858 ms 2024-09-21T07:57:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:04 smithi187 ceph-mon[34367]: pgmap v1011: 97 pgs: 97 active+clean; 493 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 382 op/s 2024-09-21T07:57:05.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 214288 20.37 MB/sec execute 442 sec latency 243.021 ms 2024-09-21T07:57:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:06 smithi123 ceph-mon[34166]: pgmap v1012: 97 pgs: 97 active+clean; 494 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 310 op/s 2024-09-21T07:57:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:06 smithi060 ceph-mon[31244]: pgmap v1012: 97 pgs: 97 active+clean; 494 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 310 op/s 2024-09-21T07:57:06.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 214565 20.36 MB/sec execute 443 sec latency 103.776 ms 2024-09-21T07:57:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:06 smithi187 ceph-mon[34367]: pgmap v1012: 97 pgs: 97 active+clean; 494 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 310 op/s 2024-09-21T07:57:07.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 214902 20.34 MB/sec execute 444 sec latency 75.431 ms 2024-09-21T07:57:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:08 smithi123 ceph-mon[34166]: pgmap v1013: 97 pgs: 97 active+clean; 496 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 336 op/s 2024-09-21T07:57:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:08 smithi060 ceph-mon[31244]: pgmap v1013: 97 pgs: 97 active+clean; 496 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 336 op/s 2024-09-21T07:57:08.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 215218 20.34 MB/sec execute 445 sec latency 73.469 ms 2024-09-21T07:57:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:08 smithi187 ceph-mon[34367]: pgmap v1013: 97 pgs: 97 active+clean; 496 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 336 op/s 2024-09-21T07:57:09.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 215654 20.33 MB/sec execute 446 sec latency 71.434 ms 2024-09-21T07:57:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:10 smithi123 ceph-mon[34166]: pgmap v1014: 97 pgs: 97 active+clean; 502 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-09-21T07:57:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:10 smithi060 ceph-mon[31244]: pgmap v1014: 97 pgs: 97 active+clean; 502 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-09-21T07:57:10.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 216014 20.33 MB/sec execute 447 sec latency 235.676 ms 2024-09-21T07:57:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:10 smithi187 ceph-mon[34367]: pgmap v1014: 97 pgs: 97 active+clean; 502 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-09-21T07:57:11.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 216442 20.34 MB/sec execute 448 sec latency 170.979 ms 2024-09-21T07:57:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:12 smithi123 ceph-mon[34166]: pgmap v1015: 97 pgs: 97 active+clean; 501 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 314 op/s 2024-09-21T07:57:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:12 smithi060 ceph-mon[31244]: pgmap v1015: 97 pgs: 97 active+clean; 501 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 314 op/s 2024-09-21T07:57:12.396 INFO:tasks.workunit.client.0.smithi060.stdout: 10 216996 20.36 MB/sec execute 449 sec latency 60.728 ms 2024-09-21T07:57:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:12 smithi187 ceph-mon[34367]: pgmap v1015: 97 pgs: 97 active+clean; 501 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 314 op/s 2024-09-21T07:57:13.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 217390 20.38 MB/sec execute 450 sec latency 68.401 ms 2024-09-21T07:57:14.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:14 smithi123 ceph-mon[34166]: pgmap v1016: 97 pgs: 97 active+clean; 498 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.6 MiB/s wr, 402 op/s 2024-09-21T07:57:14.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:14 smithi060 ceph-mon[31244]: pgmap v1016: 97 pgs: 97 active+clean; 498 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.6 MiB/s wr, 402 op/s 2024-09-21T07:57:14.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 217839 20.38 MB/sec execute 451 sec latency 54.029 ms 2024-09-21T07:57:14.526 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:14 smithi187 ceph-mon[34367]: pgmap v1016: 97 pgs: 97 active+clean; 498 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.6 MiB/s wr, 402 op/s 2024-09-21T07:57:15.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 218074 20.38 MB/sec execute 452 sec latency 257.114 ms 2024-09-21T07:57:16.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:16 smithi123 ceph-mon[34166]: pgmap v1017: 97 pgs: 97 active+clean; 484 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 325 op/s 2024-09-21T07:57:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:16 smithi060 ceph-mon[31244]: pgmap v1017: 97 pgs: 97 active+clean; 484 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 325 op/s 2024-09-21T07:57:16.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 218355 20.35 MB/sec execute 453 sec latency 81.130 ms 2024-09-21T07:57:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:16 smithi187 ceph-mon[34367]: pgmap v1017: 97 pgs: 97 active+clean; 484 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 325 op/s 2024-09-21T07:57:17.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 218722 20.35 MB/sec execute 454 sec latency 59.228 ms 2024-09-21T07:57:18.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:18 smithi123 ceph-mon[34166]: pgmap v1018: 97 pgs: 97 active+clean; 483 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 348 op/s 2024-09-21T07:57:18.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:18 smithi060 ceph-mon[31244]: pgmap v1018: 97 pgs: 97 active+clean; 483 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 348 op/s 2024-09-21T07:57:18.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 219122 20.35 MB/sec execute 455 sec latency 89.376 ms 2024-09-21T07:57:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:18 smithi187 ceph-mon[34367]: pgmap v1018: 97 pgs: 97 active+clean; 483 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 348 op/s 2024-09-21T07:57:19.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 219634 20.36 MB/sec execute 456 sec latency 83.588 ms 2024-09-21T07:57:20.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:20 smithi123 ceph-mon[34166]: pgmap v1019: 97 pgs: 97 active+clean; 489 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 380 op/s 2024-09-21T07:57:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:20 smithi060 ceph-mon[31244]: pgmap v1019: 97 pgs: 97 active+clean; 489 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 380 op/s 2024-09-21T07:57:20.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 220053 20.36 MB/sec execute 457 sec latency 188.600 ms 2024-09-21T07:57:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:20 smithi187 ceph-mon[34367]: pgmap v1019: 97 pgs: 97 active+clean; 489 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 380 op/s 2024-09-21T07:57:21.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 220507 20.37 MB/sec execute 458 sec latency 79.671 ms 2024-09-21T07:57:22.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:22 smithi123 ceph-mon[34166]: pgmap v1020: 97 pgs: 97 active+clean; 489 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 290 op/s 2024-09-21T07:57:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:22 smithi060 ceph-mon[31244]: pgmap v1020: 97 pgs: 97 active+clean; 489 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 290 op/s 2024-09-21T07:57:22.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 220905 20.39 MB/sec execute 459 sec latency 60.797 ms 2024-09-21T07:57:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:22 smithi187 ceph-mon[34367]: pgmap v1020: 97 pgs: 97 active+clean; 489 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.6 MiB/s wr, 290 op/s 2024-09-21T07:57:23.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 221319 20.39 MB/sec execute 460 sec latency 74.066 ms 2024-09-21T07:57:24.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:24 smithi123 ceph-mon[34166]: pgmap v1021: 97 pgs: 97 active+clean; 498 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 396 op/s 2024-09-21T07:57:24.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:24 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:24 smithi060 ceph-mon[31244]: pgmap v1021: 97 pgs: 97 active+clean; 498 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 396 op/s 2024-09-21T07:57:24.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:24 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:24.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 221615 20.39 MB/sec execute 461 sec latency 55.472 ms 2024-09-21T07:57:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:24 smithi187 ceph-mon[34367]: pgmap v1021: 97 pgs: 97 active+clean; 498 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 396 op/s 2024-09-21T07:57:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:24 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:57:25.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:25.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:25.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:57:25.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:25.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:25.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:57:25.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 221842 20.37 MB/sec execute 462 sec latency 374.378 ms 2024-09-21T07:57:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:57:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:57:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:57:26.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 222188 20.36 MB/sec execute 463 sec latency 343.120 ms 2024-09-21T07:57:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:26 smithi123 ceph-mon[34166]: pgmap v1022: 97 pgs: 97 active+clean; 498 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 321 op/s 2024-09-21T07:57:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:26 smithi060 ceph-mon[31244]: pgmap v1022: 97 pgs: 97 active+clean; 498 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 321 op/s 2024-09-21T07:57:26.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:26 smithi187 ceph-mon[34367]: pgmap v1022: 97 pgs: 97 active+clean; 498 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 321 op/s 2024-09-21T07:57:27.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 222453 20.33 MB/sec execute 464 sec latency 158.588 ms 2024-09-21T07:57:28.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 222876 20.34 MB/sec execute 465 sec latency 79.017 ms 2024-09-21T07:57:28.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:28 smithi123 ceph-mon[34166]: pgmap v1023: 97 pgs: 97 active+clean; 504 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 329 op/s 2024-09-21T07:57:28.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:28 smithi060 ceph-mon[31244]: pgmap v1023: 97 pgs: 97 active+clean; 504 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 329 op/s 2024-09-21T07:57:28.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:28 smithi187 ceph-mon[34367]: pgmap v1023: 97 pgs: 97 active+clean; 504 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 329 op/s 2024-09-21T07:57:29.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 223373 20.35 MB/sec execute 466 sec latency 73.232 ms 2024-09-21T07:57:30.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 223830 20.36 MB/sec execute 467 sec latency 185.001 ms 2024-09-21T07:57:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:30 smithi123 ceph-mon[34166]: pgmap v1024: 97 pgs: 97 active+clean; 508 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.2 MiB/s wr, 366 op/s 2024-09-21T07:57:30.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:30 smithi060 ceph-mon[31244]: pgmap v1024: 97 pgs: 97 active+clean; 508 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.2 MiB/s wr, 366 op/s 2024-09-21T07:57:30.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:30 smithi187 ceph-mon[34367]: pgmap v1024: 97 pgs: 97 active+clean; 508 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.2 MiB/s wr, 366 op/s 2024-09-21T07:57:31.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 224239 20.38 MB/sec execute 468 sec latency 163.457 ms 2024-09-21T07:57:32.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 224683 20.39 MB/sec execute 469 sec latency 88.214 ms 2024-09-21T07:57:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:32 smithi123 ceph-mon[34166]: pgmap v1025: 97 pgs: 97 active+clean; 507 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.0 MiB/s wr, 279 op/s 2024-09-21T07:57:32.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:32 smithi060 ceph-mon[31244]: pgmap v1025: 97 pgs: 97 active+clean; 507 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.0 MiB/s wr, 279 op/s 2024-09-21T07:57:32.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:32 smithi187 ceph-mon[34367]: pgmap v1025: 97 pgs: 97 active+clean; 507 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.0 MiB/s wr, 279 op/s 2024-09-21T07:57:33.397 INFO:tasks.workunit.client.0.smithi060.stdout: 10 225028 20.39 MB/sec execute 470 sec latency 48.163 ms 2024-09-21T07:57:34.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 225291 20.37 MB/sec execute 471 sec latency 79.800 ms 2024-09-21T07:57:34.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:34 smithi123 ceph-mon[34166]: pgmap v1026: 97 pgs: 97 active+clean; 501 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.5 MiB/s wr, 405 op/s 2024-09-21T07:57:34.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:34 smithi060 ceph-mon[31244]: pgmap v1026: 97 pgs: 97 active+clean; 501 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.5 MiB/s wr, 405 op/s 2024-09-21T07:57:34.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:34 smithi187 ceph-mon[34367]: pgmap v1026: 97 pgs: 97 active+clean; 501 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.5 MiB/s wr, 405 op/s 2024-09-21T07:57:35.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 225616 20.36 MB/sec execute 472 sec latency 147.247 ms 2024-09-21T07:57:36.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 225898 20.34 MB/sec execute 473 sec latency 228.531 ms 2024-09-21T07:57:36.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:36 smithi123 ceph-mon[34166]: pgmap v1027: 97 pgs: 97 active+clean; 489 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 310 op/s 2024-09-21T07:57:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:36 smithi060 ceph-mon[31244]: pgmap v1027: 97 pgs: 97 active+clean; 489 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 310 op/s 2024-09-21T07:57:36.769 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:36 smithi187 ceph-mon[34367]: pgmap v1027: 97 pgs: 97 active+clean; 489 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 310 op/s 2024-09-21T07:57:37.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 226213 20.33 MB/sec execute 474 sec latency 152.026 ms 2024-09-21T07:57:38.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:37 smithi060 ceph-mon[31244]: pgmap v1028: 97 pgs: 97 active+clean; 491 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 333 op/s 2024-09-21T07:57:38.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:37 smithi187 ceph-mon[34367]: pgmap v1028: 97 pgs: 97 active+clean; 491 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 333 op/s 2024-09-21T07:57:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:37 smithi123 ceph-mon[34166]: pgmap v1028: 97 pgs: 97 active+clean; 491 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 333 op/s 2024-09-21T07:57:38.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 226748 20.35 MB/sec execute 475 sec latency 91.188 ms 2024-09-21T07:57:39.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 227312 20.36 MB/sec execute 476 sec latency 51.446 ms 2024-09-21T07:57:40.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:40 smithi123 ceph-mon[34166]: pgmap v1029: 97 pgs: 97 active+clean; 497 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-09-21T07:57:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:40 smithi060 ceph-mon[31244]: pgmap v1029: 97 pgs: 97 active+clean; 497 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-09-21T07:57:40.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 227745 20.39 MB/sec execute 477 sec latency 102.679 ms 2024-09-21T07:57:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:40 smithi187 ceph-mon[34367]: pgmap v1029: 97 pgs: 97 active+clean; 497 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-09-21T07:57:41.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 228156 20.40 MB/sec execute 478 sec latency 257.541 ms 2024-09-21T07:57:42.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:42 smithi123 ceph-mon[34166]: pgmap v1030: 97 pgs: 97 active+clean; 496 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 301 op/s 2024-09-21T07:57:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:42 smithi060 ceph-mon[31244]: pgmap v1030: 97 pgs: 97 active+clean; 496 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 301 op/s 2024-09-21T07:57:42.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 228452 20.39 MB/sec execute 479 sec latency 119.616 ms 2024-09-21T07:57:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:42 smithi187 ceph-mon[34367]: pgmap v1030: 97 pgs: 97 active+clean; 496 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 301 op/s 2024-09-21T07:57:43.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 228743 20.38 MB/sec execute 480 sec latency 67.530 ms 2024-09-21T07:57:44.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:44 smithi123 ceph-mon[34166]: pgmap v1031: 97 pgs: 97 active+clean; 501 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 413 op/s 2024-09-21T07:57:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:44 smithi060 ceph-mon[31244]: pgmap v1031: 97 pgs: 97 active+clean; 501 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 413 op/s 2024-09-21T07:57:44.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 229081 20.38 MB/sec execute 481 sec latency 83.697 ms 2024-09-21T07:57:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:44 smithi187 ceph-mon[34367]: pgmap v1031: 97 pgs: 97 active+clean; 501 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 413 op/s 2024-09-21T07:57:45.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 229477 20.36 MB/sec execute 482 sec latency 83.572 ms 2024-09-21T07:57:46.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:46 smithi123 ceph-mon[34166]: pgmap v1032: 97 pgs: 97 active+clean; 500 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 301 op/s 2024-09-21T07:57:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:46 smithi060 ceph-mon[31244]: pgmap v1032: 97 pgs: 97 active+clean; 500 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 301 op/s 2024-09-21T07:57:46.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 229644 20.34 MB/sec execute 483 sec latency 302.554 ms 2024-09-21T07:57:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:46 smithi187 ceph-mon[34367]: pgmap v1032: 97 pgs: 97 active+clean; 500 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 301 op/s 2024-09-21T07:57:47.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 229964 20.33 MB/sec execute 484 sec latency 108.980 ms 2024-09-21T07:57:48.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:48 smithi123 ceph-mon[34166]: pgmap v1033: 97 pgs: 97 active+clean; 507 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 337 op/s 2024-09-21T07:57:48.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:48 smithi060 ceph-mon[31244]: pgmap v1033: 97 pgs: 97 active+clean; 507 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 337 op/s 2024-09-21T07:57:48.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 230346 20.33 MB/sec execute 485 sec latency 125.178 ms 2024-09-21T07:57:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:48 smithi187 ceph-mon[34367]: pgmap v1033: 97 pgs: 97 active+clean; 507 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 337 op/s 2024-09-21T07:57:49.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 230821 20.33 MB/sec execute 486 sec latency 77.129 ms 2024-09-21T07:57:50.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:50 smithi123 ceph-mon[34166]: pgmap v1034: 97 pgs: 97 active+clean; 511 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-21T07:57:50.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:50 smithi060 ceph-mon[31244]: pgmap v1034: 97 pgs: 97 active+clean; 511 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-21T07:57:50.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 231269 20.36 MB/sec execute 487 sec latency 119.504 ms 2024-09-21T07:57:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:50 smithi187 ceph-mon[34367]: pgmap v1034: 97 pgs: 97 active+clean; 511 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.1 MiB/s wr, 374 op/s 2024-09-21T07:57:51.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 231653 20.37 MB/sec execute 488 sec latency 176.888 ms 2024-09-21T07:57:52.321 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:52 smithi187 ceph-mon[34367]: pgmap v1035: 97 pgs: 97 active+clean; 506 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-09-21T07:57:52.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:52 smithi123 ceph-mon[34166]: pgmap v1035: 97 pgs: 97 active+clean; 506 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-09-21T07:57:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:52 smithi060 ceph-mon[31244]: pgmap v1035: 97 pgs: 97 active+clean; 506 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-09-21T07:57:52.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 231962 20.36 MB/sec execute 489 sec latency 81.269 ms 2024-09-21T07:57:53.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 232233 20.35 MB/sec execute 490 sec latency 79.390 ms 2024-09-21T07:57:54.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:54 smithi123 ceph-mon[34166]: pgmap v1036: 97 pgs: 97 active+clean; 504 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 407 op/s 2024-09-21T07:57:54.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:54 smithi060 ceph-mon[31244]: pgmap v1036: 97 pgs: 97 active+clean; 504 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 407 op/s 2024-09-21T07:57:54.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 232539 20.34 MB/sec execute 491 sec latency 53.301 ms 2024-09-21T07:57:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:54 smithi187 ceph-mon[34367]: pgmap v1036: 97 pgs: 97 active+clean; 504 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 407 op/s 2024-09-21T07:57:55.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 232880 20.32 MB/sec execute 492 sec latency 138.654 ms 2024-09-21T07:57:56.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:56 smithi123 ceph-mon[34166]: pgmap v1037: 97 pgs: 97 active+clean; 491 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 314 op/s 2024-09-21T07:57:56.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:56 smithi060 ceph-mon[31244]: pgmap v1037: 97 pgs: 97 active+clean; 491 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 314 op/s 2024-09-21T07:57:56.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 233192 20.31 MB/sec execute 493 sec latency 195.658 ms 2024-09-21T07:57:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:56 smithi187 ceph-mon[34367]: pgmap v1037: 97 pgs: 97 active+clean; 491 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 314 op/s 2024-09-21T07:57:57.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 233557 20.31 MB/sec execute 494 sec latency 95.157 ms 2024-09-21T07:57:58.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:57:58 smithi123 ceph-mon[34166]: pgmap v1038: 97 pgs: 97 active+clean; 497 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.0 MiB/s wr, 364 op/s 2024-09-21T07:57:58.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:57:58 smithi060 ceph-mon[31244]: pgmap v1038: 97 pgs: 97 active+clean; 497 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.0 MiB/s wr, 364 op/s 2024-09-21T07:57:58.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 234083 20.32 MB/sec execute 495 sec latency 84.883 ms 2024-09-21T07:57:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:57:58 smithi187 ceph-mon[34367]: pgmap v1038: 97 pgs: 97 active+clean; 497 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.0 MiB/s wr, 364 op/s 2024-09-21T07:57:59.398 INFO:tasks.workunit.client.0.smithi060.stdout: 10 234550 20.33 MB/sec execute 496 sec latency 87.317 ms 2024-09-21T07:58:00.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:00 smithi123 ceph-mon[34166]: pgmap v1039: 97 pgs: 97 active+clean; 500 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 382 op/s 2024-09-21T07:58:00.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:00 smithi060 ceph-mon[31244]: pgmap v1039: 97 pgs: 97 active+clean; 500 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 382 op/s 2024-09-21T07:58:00.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 234962 20.35 MB/sec execute 497 sec latency 109.610 ms 2024-09-21T07:58:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:00 smithi187 ceph-mon[34367]: pgmap v1039: 97 pgs: 97 active+clean; 500 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 382 op/s 2024-09-21T07:58:01.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 235275 20.35 MB/sec execute 498 sec latency 238.201 ms 2024-09-21T07:58:02.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:02 smithi123 ceph-mon[34166]: pgmap v1040: 97 pgs: 97 active+clean; 499 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-21T07:58:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:02 smithi060 ceph-mon[31244]: pgmap v1040: 97 pgs: 97 active+clean; 499 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-21T07:58:02.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 235567 20.35 MB/sec execute 499 sec latency 124.883 ms 2024-09-21T07:58:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:02 smithi187 ceph-mon[34367]: pgmap v1040: 97 pgs: 97 active+clean; 499 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2024-09-21T07:58:03.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 235881 20.33 MB/sec execute 500 sec latency 82.912 ms 2024-09-21T07:58:04.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:04 smithi123 ceph-mon[34166]: pgmap v1041: 97 pgs: 97 active+clean; 501 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.0 MiB/s wr, 398 op/s 2024-09-21T07:58:04.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:04 smithi060 ceph-mon[31244]: pgmap v1041: 97 pgs: 97 active+clean; 501 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.0 MiB/s wr, 398 op/s 2024-09-21T07:58:04.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 236181 20.33 MB/sec execute 501 sec latency 70.648 ms 2024-09-21T07:58:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:04 smithi187 ceph-mon[34367]: pgmap v1041: 97 pgs: 97 active+clean; 501 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.0 MiB/s wr, 398 op/s 2024-09-21T07:58:05.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 236584 20.31 MB/sec execute 502 sec latency 63.172 ms 2024-09-21T07:58:06.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:06 smithi123 ceph-mon[34166]: pgmap v1042: 97 pgs: 97 active+clean; 502 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 315 op/s 2024-09-21T07:58:06.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:06 smithi060 ceph-mon[31244]: pgmap v1042: 97 pgs: 97 active+clean; 502 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 315 op/s 2024-09-21T07:58:06.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 236863 20.30 MB/sec execute 503 sec latency 203.772 ms 2024-09-21T07:58:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:06 smithi187 ceph-mon[34367]: pgmap v1042: 97 pgs: 97 active+clean; 502 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 315 op/s 2024-09-21T07:58:07.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 237248 20.30 MB/sec execute 504 sec latency 116.707 ms 2024-09-21T07:58:08.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:08 smithi123 ceph-mon[34166]: pgmap v1043: 97 pgs: 97 active+clean; 504 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 327 op/s 2024-09-21T07:58:08.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:08 smithi060 ceph-mon[31244]: pgmap v1043: 97 pgs: 97 active+clean; 504 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 327 op/s 2024-09-21T07:58:08.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 237747 20.31 MB/sec execute 505 sec latency 74.882 ms 2024-09-21T07:58:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:08 smithi187 ceph-mon[34367]: pgmap v1043: 97 pgs: 97 active+clean; 504 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 327 op/s 2024-09-21T07:58:09.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 238235 20.33 MB/sec execute 506 sec latency 91.217 ms 2024-09-21T07:58:10.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:10 smithi123 ceph-mon[34166]: pgmap v1044: 97 pgs: 97 active+clean; 511 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-09-21T07:58:10.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:10 smithi060 ceph-mon[31244]: pgmap v1044: 97 pgs: 97 active+clean; 511 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-09-21T07:58:10.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 238671 20.35 MB/sec execute 507 sec latency 105.956 ms 2024-09-21T07:58:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:10 smithi187 ceph-mon[34367]: pgmap v1044: 97 pgs: 97 active+clean; 511 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-09-21T07:58:11.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 238876 20.33 MB/sec execute 508 sec latency 342.200 ms 2024-09-21T07:58:12.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:12 smithi123 ceph-mon[34166]: pgmap v1045: 97 pgs: 97 active+clean; 511 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 293 op/s 2024-09-21T07:58:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:12 smithi060 ceph-mon[31244]: pgmap v1045: 97 pgs: 97 active+clean; 511 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 293 op/s 2024-09-21T07:58:12.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 239169 20.33 MB/sec execute 509 sec latency 425.036 ms 2024-09-21T07:58:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:12 smithi187 ceph-mon[34367]: pgmap v1045: 97 pgs: 97 active+clean; 511 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 293 op/s 2024-09-21T07:58:13.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 239386 20.30 MB/sec execute 510 sec latency 270.820 ms 2024-09-21T07:58:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:14 smithi060 ceph-mon[31244]: pgmap v1046: 97 pgs: 97 active+clean; 517 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.1 MiB/s wr, 356 op/s 2024-09-21T07:58:14.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 239699 20.30 MB/sec execute 511 sec latency 78.638 ms 2024-09-21T07:58:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:14 smithi187 ceph-mon[34367]: pgmap v1046: 97 pgs: 97 active+clean; 517 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.1 MiB/s wr, 356 op/s 2024-09-21T07:58:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:14 smithi123 ceph-mon[34166]: pgmap v1046: 97 pgs: 97 active+clean; 517 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.1 MiB/s wr, 356 op/s 2024-09-21T07:58:15.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 240054 20.29 MB/sec execute 512 sec latency 69.574 ms 2024-09-21T07:58:16.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:16 smithi060 ceph-mon[31244]: pgmap v1047: 97 pgs: 97 active+clean; 506 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2024-09-21T07:58:16.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 240367 20.28 MB/sec execute 513 sec latency 203.605 ms 2024-09-21T07:58:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:16 smithi187 ceph-mon[34367]: pgmap v1047: 97 pgs: 97 active+clean; 506 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2024-09-21T07:58:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:16 smithi123 ceph-mon[34166]: pgmap v1047: 97 pgs: 97 active+clean; 506 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2024-09-21T07:58:17.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 240821 20.28 MB/sec execute 514 sec latency 208.703 ms 2024-09-21T07:58:18.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:18 smithi060 ceph-mon[31244]: pgmap v1048: 97 pgs: 97 active+clean; 499 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 349 op/s 2024-09-21T07:58:18.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 241389 20.30 MB/sec execute 515 sec latency 51.712 ms 2024-09-21T07:58:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:18 smithi187 ceph-mon[34367]: pgmap v1048: 97 pgs: 97 active+clean; 499 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 349 op/s 2024-09-21T07:58:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:18 smithi123 ceph-mon[34166]: pgmap v1048: 97 pgs: 97 active+clean; 499 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.7 MiB/s wr, 349 op/s 2024-09-21T07:58:19.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 241857 20.31 MB/sec execute 516 sec latency 71.440 ms 2024-09-21T07:58:20.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:20 smithi060 ceph-mon[31244]: pgmap v1049: 97 pgs: 97 active+clean; 489 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 373 op/s 2024-09-21T07:58:20.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 242329 20.34 MB/sec execute 517 sec latency 96.460 ms 2024-09-21T07:58:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:20 smithi187 ceph-mon[34367]: pgmap v1049: 97 pgs: 97 active+clean; 489 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 373 op/s 2024-09-21T07:58:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:20 smithi123 ceph-mon[34166]: pgmap v1049: 97 pgs: 97 active+clean; 489 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 373 op/s 2024-09-21T07:58:21.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 242627 20.33 MB/sec execute 518 sec latency 132.226 ms 2024-09-21T07:58:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:22 smithi060 ceph-mon[31244]: pgmap v1050: 97 pgs: 97 active+clean; 490 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 276 op/s 2024-09-21T07:58:22.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 242870 20.32 MB/sec execute 519 sec latency 374.192 ms 2024-09-21T07:58:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:22 smithi187 ceph-mon[34367]: pgmap v1050: 97 pgs: 97 active+clean; 490 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 276 op/s 2024-09-21T07:58:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:22 smithi123 ceph-mon[34166]: pgmap v1050: 97 pgs: 97 active+clean; 490 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 276 op/s 2024-09-21T07:58:23.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 243111 20.30 MB/sec execute 520 sec latency 84.608 ms 2024-09-21T07:58:24.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:24 smithi060 ceph-mon[31244]: pgmap v1051: 97 pgs: 97 active+clean; 503 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-09-21T07:58:24.399 INFO:tasks.workunit.client.0.smithi060.stdout: 10 243473 20.29 MB/sec execute 521 sec latency 67.946 ms 2024-09-21T07:58:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:24 smithi187 ceph-mon[34367]: pgmap v1051: 97 pgs: 97 active+clean; 503 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-09-21T07:58:24.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:24 smithi123 ceph-mon[34166]: pgmap v1051: 97 pgs: 97 active+clean; 503 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-09-21T07:58:25.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:25.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:25.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:25.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:58:25.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 243929 20.30 MB/sec execute 522 sec latency 70.051 ms 2024-09-21T07:58:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:58:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:58:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:58:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:58:25.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:58:26.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:26 smithi060 ceph-mon[31244]: pgmap v1052: 97 pgs: 97 active+clean; 504 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.0 MiB/s wr, 314 op/s 2024-09-21T07:58:26.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 244358 20.30 MB/sec execute 523 sec latency 65.573 ms 2024-09-21T07:58:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:26 smithi187 ceph-mon[34367]: pgmap v1052: 97 pgs: 97 active+clean; 504 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.0 MiB/s wr, 314 op/s 2024-09-21T07:58:26.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:26 smithi123 ceph-mon[34166]: pgmap v1052: 97 pgs: 97 active+clean; 504 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.0 MiB/s wr, 314 op/s 2024-09-21T07:58:27.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 244797 20.30 MB/sec execute 524 sec latency 218.800 ms 2024-09-21T07:58:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:28 smithi060 ceph-mon[31244]: pgmap v1053: 97 pgs: 97 active+clean; 505 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-09-21T07:58:28.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 245273 20.32 MB/sec execute 525 sec latency 66.286 ms 2024-09-21T07:58:28.400 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:28 smithi123 ceph-mon[34166]: pgmap v1053: 97 pgs: 97 active+clean; 505 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-09-21T07:58:28.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:28 smithi187 ceph-mon[34367]: pgmap v1053: 97 pgs: 97 active+clean; 505 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 351 op/s 2024-09-21T07:58:29.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 245759 20.33 MB/sec execute 526 sec latency 77.393 ms 2024-09-21T07:58:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:30 smithi060 ceph-mon[31244]: pgmap v1054: 97 pgs: 97 active+clean; 506 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.2 MiB/s wr, 336 op/s 2024-09-21T07:58:30.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 246112 20.34 MB/sec execute 527 sec latency 75.294 ms 2024-09-21T07:58:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:30 smithi187 ceph-mon[34367]: pgmap v1054: 97 pgs: 97 active+clean; 506 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.2 MiB/s wr, 336 op/s 2024-09-21T07:58:30.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:30 smithi123 ceph-mon[34166]: pgmap v1054: 97 pgs: 97 active+clean; 506 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.2 MiB/s wr, 336 op/s 2024-09-21T07:58:31.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 246376 20.33 MB/sec execute 528 sec latency 208.858 ms 2024-09-21T07:58:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:32 smithi060 ceph-mon[31244]: pgmap v1055: 97 pgs: 97 active+clean; 502 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 281 op/s 2024-09-21T07:58:32.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 246609 20.31 MB/sec execute 529 sec latency 327.932 ms 2024-09-21T07:58:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:32 smithi187 ceph-mon[34367]: pgmap v1055: 97 pgs: 97 active+clean; 502 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 281 op/s 2024-09-21T07:58:32.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:32 smithi123 ceph-mon[34166]: pgmap v1055: 97 pgs: 97 active+clean; 502 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 281 op/s 2024-09-21T07:58:33.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 246893 20.30 MB/sec execute 530 sec latency 76.132 ms 2024-09-21T07:58:34.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:34 smithi060 ceph-mon[31244]: pgmap v1056: 97 pgs: 97 active+clean; 491 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 353 op/s 2024-09-21T07:58:34.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 247251 20.30 MB/sec execute 531 sec latency 62.411 ms 2024-09-21T07:58:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:34 smithi187 ceph-mon[34367]: pgmap v1056: 97 pgs: 97 active+clean; 491 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 353 op/s 2024-09-21T07:58:34.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:34 smithi123 ceph-mon[34166]: pgmap v1056: 97 pgs: 97 active+clean; 491 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 353 op/s 2024-09-21T07:58:35.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 247728 20.29 MB/sec execute 532 sec latency 83.408 ms 2024-09-21T07:58:36.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 248185 20.31 MB/sec execute 533 sec latency 65.023 ms 2024-09-21T07:58:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:36 smithi187 ceph-mon[34367]: pgmap v1057: 97 pgs: 97 active+clean; 492 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2024-09-21T07:58:36.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:36 smithi123 ceph-mon[34166]: pgmap v1057: 97 pgs: 97 active+clean; 492 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2024-09-21T07:58:36.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:36 smithi060 ceph-mon[31244]: pgmap v1057: 97 pgs: 97 active+clean; 492 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 320 op/s 2024-09-21T07:58:37.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 248684 20.31 MB/sec execute 534 sec latency 142.762 ms 2024-09-21T07:58:38.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 249052 20.33 MB/sec execute 535 sec latency 74.265 ms 2024-09-21T07:58:38.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:38 smithi187 ceph-mon[34367]: pgmap v1058: 97 pgs: 97 active+clean; 493 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-09-21T07:58:38.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:38 smithi123 ceph-mon[34166]: pgmap v1058: 97 pgs: 97 active+clean; 493 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-09-21T07:58:38.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:38 smithi060 ceph-mon[31244]: pgmap v1058: 97 pgs: 97 active+clean; 493 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-09-21T07:58:39.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 249490 20.33 MB/sec execute 536 sec latency 79.262 ms 2024-09-21T07:58:40.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 249830 20.34 MB/sec execute 537 sec latency 65.904 ms 2024-09-21T07:58:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:40 smithi187 ceph-mon[34367]: pgmap v1059: 97 pgs: 97 active+clean; 494 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-09-21T07:58:40.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:40 smithi123 ceph-mon[34166]: pgmap v1059: 97 pgs: 97 active+clean; 494 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-09-21T07:58:40.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:40 smithi060 ceph-mon[31244]: pgmap v1059: 97 pgs: 97 active+clean; 494 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-09-21T07:58:41.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 250152 20.32 MB/sec execute 538 sec latency 86.826 ms 2024-09-21T07:58:42.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 250413 20.30 MB/sec execute 539 sec latency 263.882 ms 2024-09-21T07:58:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:42 smithi187 ceph-mon[34367]: pgmap v1060: 97 pgs: 97 active+clean; 494 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.8 MiB/s wr, 282 op/s 2024-09-21T07:58:42.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:42 smithi123 ceph-mon[34166]: pgmap v1060: 97 pgs: 97 active+clean; 494 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.8 MiB/s wr, 282 op/s 2024-09-21T07:58:42.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:42 smithi060 ceph-mon[31244]: pgmap v1060: 97 pgs: 97 active+clean; 494 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.8 MiB/s wr, 282 op/s 2024-09-21T07:58:43.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 250688 20.30 MB/sec execute 540 sec latency 192.055 ms 2024-09-21T07:58:44.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 251129 20.30 MB/sec execute 541 sec latency 65.713 ms 2024-09-21T07:58:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:44 smithi187 ceph-mon[34367]: pgmap v1061: 97 pgs: 97 active+clean; 501 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 379 op/s 2024-09-21T07:58:44.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:44 smithi123 ceph-mon[34166]: pgmap v1061: 97 pgs: 97 active+clean; 501 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 379 op/s 2024-09-21T07:58:44.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:44 smithi060 ceph-mon[31244]: pgmap v1061: 97 pgs: 97 active+clean; 501 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 379 op/s 2024-09-21T07:58:45.400 INFO:tasks.workunit.client.0.smithi060.stdout: 10 251586 20.30 MB/sec execute 542 sec latency 79.749 ms 2024-09-21T07:58:46.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 252016 20.31 MB/sec execute 543 sec latency 124.792 ms 2024-09-21T07:58:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:46 smithi187 ceph-mon[34367]: pgmap v1062: 97 pgs: 97 active+clean; 503 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-09-21T07:58:46.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:46 smithi123 ceph-mon[34166]: pgmap v1062: 97 pgs: 97 active+clean; 503 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-09-21T07:58:46.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:46 smithi060 ceph-mon[31244]: pgmap v1062: 97 pgs: 97 active+clean; 503 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 330 op/s 2024-09-21T07:58:47.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 252354 20.31 MB/sec execute 544 sec latency 222.510 ms 2024-09-21T07:58:48.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 252715 20.33 MB/sec execute 545 sec latency 101.842 ms 2024-09-21T07:58:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:48 smithi187 ceph-mon[34367]: pgmap v1063: 97 pgs: 97 active+clean; 508 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 350 op/s 2024-09-21T07:58:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:48 smithi123 ceph-mon[34166]: pgmap v1063: 97 pgs: 97 active+clean; 508 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 350 op/s 2024-09-21T07:58:48.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:48 smithi060 ceph-mon[31244]: pgmap v1063: 97 pgs: 97 active+clean; 508 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 350 op/s 2024-09-21T07:58:49.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 253046 20.32 MB/sec execute 546 sec latency 74.118 ms 2024-09-21T07:58:50.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 253340 20.31 MB/sec execute 547 sec latency 103.473 ms 2024-09-21T07:58:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:50 smithi187 ceph-mon[34367]: pgmap v1064: 97 pgs: 97 active+clean; 508 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 372 op/s 2024-09-21T07:58:50.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:50 smithi123 ceph-mon[34166]: pgmap v1064: 97 pgs: 97 active+clean; 508 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 372 op/s 2024-09-21T07:58:50.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:50 smithi060 ceph-mon[31244]: pgmap v1064: 97 pgs: 97 active+clean; 508 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 372 op/s 2024-09-21T07:58:51.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 253603 20.30 MB/sec execute 548 sec latency 125.033 ms 2024-09-21T07:58:52.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 253891 20.28 MB/sec execute 549 sec latency 303.004 ms 2024-09-21T07:58:52.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:52 smithi187 ceph-mon[34367]: pgmap v1065: 97 pgs: 97 active+clean; 507 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 300 op/s 2024-09-21T07:58:52.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:52 smithi123 ceph-mon[34166]: pgmap v1065: 97 pgs: 97 active+clean; 507 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 300 op/s 2024-09-21T07:58:52.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:52 smithi060 ceph-mon[31244]: pgmap v1065: 97 pgs: 97 active+clean; 507 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.7 MiB/s wr, 300 op/s 2024-09-21T07:58:53.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 254174 20.27 MB/sec execute 550 sec latency 168.061 ms 2024-09-21T07:58:54.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 254723 20.28 MB/sec execute 551 sec latency 72.463 ms 2024-09-21T07:58:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:54 smithi187 ceph-mon[34367]: pgmap v1066: 97 pgs: 97 active+clean; 497 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-09-21T07:58:54.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:54 smithi123 ceph-mon[34166]: pgmap v1066: 97 pgs: 97 active+clean; 497 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-09-21T07:58:54.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:54 smithi060 ceph-mon[31244]: pgmap v1066: 97 pgs: 97 active+clean; 497 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-09-21T07:58:55.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 255164 20.29 MB/sec execute 552 sec latency 73.793 ms 2024-09-21T07:58:56.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 255736 20.30 MB/sec execute 553 sec latency 63.650 ms 2024-09-21T07:58:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:56 smithi187 ceph-mon[34367]: pgmap v1067: 97 pgs: 97 active+clean; 492 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.1 MiB/s wr, 305 op/s 2024-09-21T07:58:56.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:56 smithi123 ceph-mon[34166]: pgmap v1067: 97 pgs: 97 active+clean; 492 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.1 MiB/s wr, 305 op/s 2024-09-21T07:58:56.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:56 smithi060 ceph-mon[31244]: pgmap v1067: 97 pgs: 97 active+clean; 492 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.1 MiB/s wr, 305 op/s 2024-09-21T07:58:57.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 256053 20.31 MB/sec execute 554 sec latency 187.683 ms 2024-09-21T07:58:58.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 256348 20.31 MB/sec execute 555 sec latency 152.633 ms 2024-09-21T07:58:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:58:58 smithi187 ceph-mon[34367]: pgmap v1068: 97 pgs: 97 active+clean; 496 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-09-21T07:58:58.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:58:58 smithi123 ceph-mon[34166]: pgmap v1068: 97 pgs: 97 active+clean; 496 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-09-21T07:58:58.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:58:58 smithi060 ceph-mon[31244]: pgmap v1068: 97 pgs: 97 active+clean; 496 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-09-21T07:58:59.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 256752 20.31 MB/sec execute 556 sec latency 88.631 ms 2024-09-21T07:59:00.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 257041 20.31 MB/sec execute 557 sec latency 69.315 ms 2024-09-21T07:59:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:00 smithi187 ceph-mon[34367]: pgmap v1069: 97 pgs: 97 active+clean; 495 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 353 op/s 2024-09-21T07:59:00.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:00 smithi123 ceph-mon[34166]: pgmap v1069: 97 pgs: 97 active+clean; 495 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 353 op/s 2024-09-21T07:59:00.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:00 smithi060 ceph-mon[31244]: pgmap v1069: 97 pgs: 97 active+clean; 495 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 353 op/s 2024-09-21T07:59:01.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 257446 20.29 MB/sec execute 558 sec latency 87.842 ms 2024-09-21T07:59:02.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 257786 20.29 MB/sec execute 559 sec latency 145.801 ms 2024-09-21T07:59:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:02 smithi187 ceph-mon[34367]: pgmap v1070: 97 pgs: 97 active+clean; 495 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2024-09-21T07:59:02.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:02 smithi123 ceph-mon[34166]: pgmap v1070: 97 pgs: 97 active+clean; 495 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2024-09-21T07:59:02.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:02 smithi060 ceph-mon[31244]: pgmap v1070: 97 pgs: 97 active+clean; 495 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.7 MiB/s wr, 291 op/s 2024-09-21T07:59:03.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 258128 20.28 MB/sec execute 560 sec latency 169.066 ms 2024-09-21T07:59:04.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 258654 20.30 MB/sec execute 561 sec latency 59.498 ms 2024-09-21T07:59:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:04 smithi187 ceph-mon[34367]: pgmap v1071: 97 pgs: 97 active+clean; 503 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 392 op/s 2024-09-21T07:59:04.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:04 smithi123 ceph-mon[34166]: pgmap v1071: 97 pgs: 97 active+clean; 503 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 392 op/s 2024-09-21T07:59:04.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:04 smithi060 ceph-mon[31244]: pgmap v1071: 97 pgs: 97 active+clean; 503 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 392 op/s 2024-09-21T07:59:05.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 259183 20.31 MB/sec execute 562 sec latency 56.313 ms 2024-09-21T07:59:06.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 259575 20.32 MB/sec execute 563 sec latency 62.146 ms 2024-09-21T07:59:06.423 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:06 smithi060 ceph-mon[31244]: pgmap v1072: 97 pgs: 97 active+clean; 503 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 350 op/s 2024-09-21T07:59:06.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:06 smithi187 ceph-mon[34367]: pgmap v1072: 97 pgs: 97 active+clean; 503 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 350 op/s 2024-09-21T07:59:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:06 smithi123 ceph-mon[34166]: pgmap v1072: 97 pgs: 97 active+clean; 503 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 350 op/s 2024-09-21T07:59:07.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 259898 20.33 MB/sec execute 564 sec latency 162.918 ms 2024-09-21T07:59:08.401 INFO:tasks.workunit.client.0.smithi060.stdout: 10 260093 20.31 MB/sec execute 565 sec latency 298.413 ms 2024-09-21T07:59:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:08 smithi187 ceph-mon[34367]: pgmap v1073: 97 pgs: 97 active+clean; 500 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.9 MiB/s wr, 381 op/s 2024-09-21T07:59:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:08 smithi123 ceph-mon[34166]: pgmap v1073: 97 pgs: 97 active+clean; 500 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.9 MiB/s wr, 381 op/s 2024-09-21T07:59:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:08 smithi060 ceph-mon[31244]: pgmap v1073: 97 pgs: 97 active+clean; 500 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.9 MiB/s wr, 381 op/s 2024-09-21T07:59:09.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 260377 20.30 MB/sec execute 566 sec latency 95.492 ms 2024-09-21T07:59:10.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 260652 20.29 MB/sec execute 567 sec latency 77.857 ms 2024-09-21T07:59:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:10 smithi187 ceph-mon[34367]: pgmap v1074: 97 pgs: 97 active+clean; 485 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 353 op/s 2024-09-21T07:59:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:10 smithi123 ceph-mon[34166]: pgmap v1074: 97 pgs: 97 active+clean; 485 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 353 op/s 2024-09-21T07:59:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:10 smithi060 ceph-mon[31244]: pgmap v1074: 97 pgs: 97 active+clean; 485 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 353 op/s 2024-09-21T07:59:11.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 261064 20.28 MB/sec execute 568 sec latency 59.975 ms 2024-09-21T07:59:12.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 261464 20.28 MB/sec execute 569 sec latency 78.870 ms 2024-09-21T07:59:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:12 smithi187 ceph-mon[34367]: pgmap v1075: 97 pgs: 97 active+clean; 485 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 288 op/s 2024-09-21T07:59:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:12 smithi123 ceph-mon[34166]: pgmap v1075: 97 pgs: 97 active+clean; 485 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 288 op/s 2024-09-21T07:59:12.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:12 smithi060 ceph-mon[31244]: pgmap v1075: 97 pgs: 97 active+clean; 485 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.8 MiB/s wr, 288 op/s 2024-09-21T07:59:13.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 261819 20.27 MB/sec execute 570 sec latency 186.325 ms 2024-09-21T07:59:14.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 262330 20.29 MB/sec execute 571 sec latency 62.119 ms 2024-09-21T07:59:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:14 smithi187 ceph-mon[34367]: pgmap v1076: 97 pgs: 97 active+clean; 491 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 385 op/s 2024-09-21T07:59:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:14 smithi123 ceph-mon[34166]: pgmap v1076: 97 pgs: 97 active+clean; 491 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 385 op/s 2024-09-21T07:59:14.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:14 smithi060 ceph-mon[31244]: pgmap v1076: 97 pgs: 97 active+clean; 491 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 385 op/s 2024-09-21T07:59:15.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 262855 20.31 MB/sec execute 572 sec latency 77.247 ms 2024-09-21T07:59:16.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 263259 20.33 MB/sec execute 573 sec latency 68.158 ms 2024-09-21T07:59:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:16 smithi187 ceph-mon[34367]: pgmap v1077: 97 pgs: 97 active+clean; 490 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 303 op/s 2024-09-21T07:59:16.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:16 smithi123 ceph-mon[34166]: pgmap v1077: 97 pgs: 97 active+clean; 490 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 303 op/s 2024-09-21T07:59:16.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:16 smithi060 ceph-mon[31244]: pgmap v1077: 97 pgs: 97 active+clean; 490 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.3 MiB/s wr, 303 op/s 2024-09-21T07:59:17.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 263608 20.33 MB/sec execute 574 sec latency 109.077 ms 2024-09-21T07:59:18.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 263830 20.31 MB/sec execute 575 sec latency 277.492 ms 2024-09-21T07:59:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:18 smithi187 ceph-mon[34367]: pgmap v1078: 97 pgs: 97 active+clean; 492 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 323 op/s 2024-09-21T07:59:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:18 smithi123 ceph-mon[34166]: pgmap v1078: 97 pgs: 97 active+clean; 492 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 323 op/s 2024-09-21T07:59:18.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:18 smithi060 ceph-mon[31244]: pgmap v1078: 97 pgs: 97 active+clean; 492 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 323 op/s 2024-09-21T07:59:19.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 264068 20.29 MB/sec execute 576 sec latency 103.108 ms 2024-09-21T07:59:20.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 264406 20.28 MB/sec execute 577 sec latency 83.839 ms 2024-09-21T07:59:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:20 smithi187 ceph-mon[34367]: pgmap v1079: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 327 op/s 2024-09-21T07:59:20.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:20 smithi123 ceph-mon[34166]: pgmap v1079: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 327 op/s 2024-09-21T07:59:20.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:20 smithi060 ceph-mon[31244]: pgmap v1079: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.5 MiB/s wr, 327 op/s 2024-09-21T07:59:21.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 264820 20.28 MB/sec execute 578 sec latency 77.229 ms 2024-09-21T07:59:22.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 265314 20.29 MB/sec execute 579 sec latency 57.961 ms 2024-09-21T07:59:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:22 smithi187 ceph-mon[34367]: pgmap v1080: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 277 op/s 2024-09-21T07:59:22.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:22 smithi123 ceph-mon[34166]: pgmap v1080: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 277 op/s 2024-09-21T07:59:22.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:22 smithi060 ceph-mon[31244]: pgmap v1080: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 277 op/s 2024-09-21T07:59:23.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 265785 20.30 MB/sec execute 580 sec latency 212.201 ms 2024-09-21T07:59:24.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 266217 20.30 MB/sec execute 581 sec latency 104.791 ms 2024-09-21T07:59:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:24 smithi187 ceph-mon[34367]: pgmap v1081: 97 pgs: 97 active+clean; 503 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 384 op/s 2024-09-21T07:59:24.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:24 smithi123 ceph-mon[34166]: pgmap v1081: 97 pgs: 97 active+clean; 503 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 384 op/s 2024-09-21T07:59:24.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:24 smithi060 ceph-mon[31244]: pgmap v1081: 97 pgs: 97 active+clean; 503 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 384 op/s 2024-09-21T07:59:25.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 266608 20.30 MB/sec execute 582 sec latency 180.330 ms 2024-09-21T07:59:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:25 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:25.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:25 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:25.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:25 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:59:26.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 266950 20.32 MB/sec execute 583 sec latency 305.455 ms 2024-09-21T07:59:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:26 smithi187 ceph-mon[34367]: pgmap v1082: 97 pgs: 97 active+clean; 506 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-09-21T07:59:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:26.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:59:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:26 smithi123 ceph-mon[34166]: pgmap v1082: 97 pgs: 97 active+clean; 506 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-09-21T07:59:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:26.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:59:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:26 smithi060 ceph-mon[31244]: pgmap v1082: 97 pgs: 97 active+clean; 506 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 311 op/s 2024-09-21T07:59:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:59:26.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:59:26.622 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T07:59:27.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 267319 20.31 MB/sec execute 584 sec latency 86.002 ms 2024-09-21T07:59:28.269 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:27 smithi187 ceph-mon[34367]: pgmap v1083: 97 pgs: 97 active+clean; 506 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 317 op/s 2024-09-21T07:59:28.351 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:27 smithi123 ceph-mon[34166]: pgmap v1083: 97 pgs: 97 active+clean; 506 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 317 op/s 2024-09-21T07:59:28.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:27 smithi060 ceph-mon[31244]: pgmap v1083: 97 pgs: 97 active+clean; 506 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 317 op/s 2024-09-21T07:59:28.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 267501 20.30 MB/sec execute 585 sec latency 406.600 ms 2024-09-21T07:59:29.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 267775 20.28 MB/sec execute 586 sec latency 77.542 ms 2024-09-21T07:59:30.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:30 smithi123 ceph-mon[34166]: pgmap v1084: 97 pgs: 97 active+clean; 516 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.0 MiB/s wr, 378 op/s 2024-09-21T07:59:30.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:30 smithi060 ceph-mon[31244]: pgmap v1084: 97 pgs: 97 active+clean; 516 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.0 MiB/s wr, 378 op/s 2024-09-21T07:59:30.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 268092 20.27 MB/sec execute 587 sec latency 177.294 ms 2024-09-21T07:59:30.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:30 smithi187 ceph-mon[34367]: pgmap v1084: 97 pgs: 97 active+clean; 516 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.0 MiB/s wr, 378 op/s 2024-09-21T07:59:31.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 268557 20.27 MB/sec execute 588 sec latency 85.395 ms 2024-09-21T07:59:32.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:32 smithi123 ceph-mon[34166]: pgmap v1085: 97 pgs: 97 active+clean; 504 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 303 op/s 2024-09-21T07:59:32.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:32 smithi060 ceph-mon[31244]: pgmap v1085: 97 pgs: 97 active+clean; 504 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 303 op/s 2024-09-21T07:59:32.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 268967 20.28 MB/sec execute 589 sec latency 58.119 ms 2024-09-21T07:59:32.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:32 smithi187 ceph-mon[34367]: pgmap v1085: 97 pgs: 97 active+clean; 504 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.0 MiB/s wr, 303 op/s 2024-09-21T07:59:33.402 INFO:tasks.workunit.client.0.smithi060.stdout: 10 269386 20.28 MB/sec execute 590 sec latency 222.855 ms 2024-09-21T07:59:34.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:34 smithi123 ceph-mon[34166]: pgmap v1086: 97 pgs: 97 active+clean; 491 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.6 MiB/s wr, 391 op/s 2024-09-21T07:59:34.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:34 smithi060 ceph-mon[31244]: pgmap v1086: 97 pgs: 97 active+clean; 491 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.6 MiB/s wr, 391 op/s 2024-09-21T07:59:34.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 269819 20.29 MB/sec execute 591 sec latency 137.676 ms 2024-09-21T07:59:34.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:34 smithi187 ceph-mon[34367]: pgmap v1086: 97 pgs: 97 active+clean; 491 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.6 MiB/s wr, 391 op/s 2024-09-21T07:59:35.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 270205 20.30 MB/sec execute 592 sec latency 71.030 ms 2024-09-21T07:59:36.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:36 smithi123 ceph-mon[34166]: pgmap v1087: 97 pgs: 97 active+clean; 490 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 319 op/s 2024-09-21T07:59:36.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:36 smithi060 ceph-mon[31244]: pgmap v1087: 97 pgs: 97 active+clean; 490 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 319 op/s 2024-09-21T07:59:36.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 270602 20.31 MB/sec execute 593 sec latency 106.103 ms 2024-09-21T07:59:36.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:36 smithi187 ceph-mon[34367]: pgmap v1087: 97 pgs: 97 active+clean; 490 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 319 op/s 2024-09-21T07:59:37.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 270939 20.30 MB/sec execute 594 sec latency 82.633 ms 2024-09-21T07:59:38.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:38 smithi123 ceph-mon[34166]: pgmap v1088: 97 pgs: 97 active+clean; 490 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 323 op/s 2024-09-21T07:59:38.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:38 smithi060 ceph-mon[31244]: pgmap v1088: 97 pgs: 97 active+clean; 490 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 323 op/s 2024-09-21T07:59:38.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 271151 20.28 MB/sec execute 595 sec latency 246.992 ms 2024-09-21T07:59:38.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:38 smithi187 ceph-mon[34367]: pgmap v1088: 97 pgs: 97 active+clean; 490 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 323 op/s 2024-09-21T07:59:39.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 271447 20.27 MB/sec execute 596 sec latency 140.130 ms 2024-09-21T07:59:40.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:40 smithi060 ceph-mon[31244]: pgmap v1089: 97 pgs: 97 active+clean; 494 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 378 op/s 2024-09-21T07:59:40.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 271830 20.27 MB/sec execute 597 sec latency 113.632 ms 2024-09-21T07:59:40.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:40 smithi187 ceph-mon[34367]: pgmap v1089: 97 pgs: 97 active+clean; 494 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 378 op/s 2024-09-21T07:59:40.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:40 smithi123 ceph-mon[34166]: pgmap v1089: 97 pgs: 97 active+clean; 494 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 378 op/s 2024-09-21T07:59:41.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 272291 20.27 MB/sec execute 598 sec latency 69.072 ms 2024-09-21T07:59:42.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:42 smithi060 ceph-mon[31244]: pgmap v1090: 97 pgs: 97 active+clean; 494 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 278 op/s 2024-09-21T07:59:42.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 272780 20.28 MB/sec execute 599 sec latency 107.078 ms 2024-09-21T07:59:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:42 smithi187 ceph-mon[34367]: pgmap v1090: 97 pgs: 97 active+clean; 494 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 278 op/s 2024-09-21T07:59:42.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:42 smithi123 ceph-mon[34166]: pgmap v1090: 97 pgs: 97 active+clean; 494 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.2 MiB/s wr, 278 op/s 2024-09-21T07:59:43.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 cleanup 600 sec 2024-09-21T07:59:44.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:44 smithi060 ceph-mon[31244]: pgmap v1091: 97 pgs: 97 active+clean; 498 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-09-21T07:59:44.403 INFO:tasks.workunit.client.0.smithi060.stdout: 10 cleanup 601 sec 2024-09-21T07:59:44.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:44 smithi187 ceph-mon[34367]: pgmap v1091: 97 pgs: 97 active+clean; 498 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-09-21T07:59:44.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:44 smithi123 ceph-mon[34166]: pgmap v1091: 97 pgs: 97 active+clean; 498 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-09-21T07:59:45.403 INFO:tasks.workunit.client.0.smithi060.stdout: 1 cleanup 602 sec 2024-09-21T07:59:45.601 INFO:tasks.workunit.client.0.smithi060.stdout: 0 cleanup 602 sec 2024-09-21T07:59:45.601 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-21T07:59:45.601 INFO:tasks.workunit.client.0.smithi060.stdout: Operation Count AvgLat MaxLat 2024-09-21T07:59:45.601 INFO:tasks.workunit.client.0.smithi060.stdout: ---------------------------------------- 2024-09-21T07:59:45.601 INFO:tasks.workunit.client.0.smithi060.stdout: NTCreateX 390044 6.679 546.988 2024-09-21T07:59:45.601 INFO:tasks.workunit.client.0.smithi060.stdout: Close 286562 0.003 0.166 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Rename 16547 27.575 425.021 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Unlink 78749 9.569 375.928 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Qpathinfo 353948 4.849 402.043 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Qfileinfo 61775 0.001 0.046 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Qfsinfo 64849 0.277 305.443 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Sfileinfo 31823 0.367 206.997 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Find 136833 0.609 275.579 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: WriteX 192900 0.084 219.240 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: ReadX 612704 0.024 170.509 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: LockX 1274 9.289 168.615 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: UnlockX 1274 7.699 66.023 2024-09-21T07:59:45.602 INFO:tasks.workunit.client.0.smithi060.stdout: Flush 27350 10.915 391.283 2024-09-21T07:59:45.603 INFO:tasks.workunit.client.0.smithi060.stdout: 2024-09-21T07:59:45.603 INFO:tasks.workunit.client.0.smithi060.stdout:Throughput 20.2799 MB/sec 10 clients 10 procs max_latency=546.990 ms 2024-09-21T07:59:45.603 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T07:59:45.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:59:46.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:46 smithi060 ceph-mon[31244]: pgmap v1092: 97 pgs: 97 active+clean; 501 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 320 op/s 2024-09-21T07:59:46.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:46 smithi187 ceph-mon[34367]: pgmap v1092: 97 pgs: 97 active+clean; 501 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 320 op/s 2024-09-21T07:59:46.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:46 smithi123 ceph-mon[34166]: pgmap v1092: 97 pgs: 97 active+clean; 501 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 320 op/s 2024-09-21T07:59:46.612 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-09-21T07:59:46.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T07:59:46.915 DEBUG:teuthology.parallel:result is None 2024-09-21T07:59:46.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:59:46.953 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:59:46.953 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T07:59:46.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:59:47.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 -- 172.21.15.60:0/167429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 msgr2=0x7f1438103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 --2- 172.21.15.60:0/167429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f1438103a00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f142c009900 tx=0x7f142c02a410 comp rx=0 tx=0).stop 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 -- 172.21.15.60:0/167429162 shutdown_connections 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 --2- 172.21.15.60:0/167429162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1438103f90 0x7f143810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 --2- 172.21.15.60:0/167429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f1438103a00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 --2- 172.21.15.60:0/167429162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438102570 0x7f14381029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 -- 172.21.15.60:0/167429162 >> 172.21.15.60:0/167429162 conn(0x7f14380fdeb0 msgr2=0x7f1438100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 -- 172.21.15.60:0/167429162 shutdown_connections 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 -- 172.21.15.60:0/167429162 wait complete. 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.105+0000 7f143db90640 1 Processor -- start 2024-09-21T07:59:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 -- start start 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1438102570 0x7f1438199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f143819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438103f90 0x7f143819b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f143810f300 con 0x7f14381035f0 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f143810f180 con 0x7f1438102570 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f143db90640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f143810f480 con 0x7f1438103f90 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f143819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f143819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36724/0 (socket says 172.21.15.60:36724) 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 -- 172.21.15.60:0/257328253 learned_addr learned my addr 172.21.15.60:0/257328253 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f14377fe640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1438102570 0x7f1438199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1437fff640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438103f90 0x7f143819b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 -- 172.21.15.60:0/257328253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438103f90 msgr2=0x7f143819b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438103f90 0x7f143819b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 -- 172.21.15.60:0/257328253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1438102570 msgr2=0x7f1438199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1438102570 0x7f1438199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1436ffd640 1 -- 172.21.15.60:0/257328253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143819b970 con 0x7f14381035f0 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.106+0000 7f1437fff640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438103f90 0x7f143819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.107+0000 7f1436ffd640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f143819a5a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f142c006010 tx=0x7f142c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.107+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c03f030 con 0x7f14381035f0 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.107+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f142c003cb0 con 0x7f14381035f0 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.107+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143819bc00 con 0x7f14381035f0 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.107+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c035070 con 0x7f14381035f0 2024-09-21T07:59:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.107+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14381a2350 con 0x7f14381035f0 2024-09-21T07:59:47.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.108+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14381029e0 con 0x7f14381035f0 2024-09-21T07:59:47.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.109+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f142c042030 con 0x7f14381035f0 2024-09-21T07:59:47.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.110+0000 7f1434ff9640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f14200b6590 0x7f14200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.110+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f142c107f50 con 0x7f14381035f0 2024-09-21T07:59:47.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.110+0000 7f14377fe640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f14200b6590 0x7f14200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.111+0000 7f14377fe640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f14200b6590 0x7f14200b8aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1428005d00 tx=0x7f142800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.113+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f142c0ce810 con 0x7f14381035f0 2024-09-21T07:59:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.305+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f143802e640 con 0x7f14381035f0 2024-09-21T07:59:47.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.306+0000 7f1434ff9640 1 -- 172.21.15.60:0/257328253 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22654 (secure 0 0 0) 0x7f142c0d2bf0 con 0x7f14381035f0 2024-09-21T07:59:47.308 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:59:47.309 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:33:33.924895+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:59:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.308+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f14200b6590 msgr2=0x7f14200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.308+0000 7f143db90640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f14200b6590 0x7f14200b8aa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1428005d00 tx=0x7f142800b410 comp rx=0 tx=0).stop 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 msgr2=0x7f143819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f143819a5a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f142c006010 tx=0x7f142c004340 comp rx=0 tx=0).stop 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 shutdown_connections 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f14200b6590 0x7f14200b8aa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1438103f90 0x7f143819b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14381035f0 0x7f143819a5a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 --2- 172.21.15.60:0/257328253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1438102570 0x7f1438199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 >> 172.21.15.60:0/257328253 conn(0x7f14380fdeb0 msgr2=0x7f14381068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 shutdown_connections 2024-09-21T07:59:47.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.309+0000 7f143db90640 1 -- 172.21.15.60:0/257328253 wait complete. 2024-09-21T07:59:47.323 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:28:22.984982+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:32:50.091500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:32:51.944737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:59:47.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:59:47.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 -- 172.21.15.60:0/3073789151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c103fa0 msgr2=0x7f546c10a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 --2- 172.21.15.60:0/3073789151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c103fa0 0x7f546c10a940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f545c009ca0 tx=0x7f545c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 -- 172.21.15.60:0/3073789151 shutdown_connections 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 --2- 172.21.15.60:0/3073789151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c103fa0 0x7f546c10a940 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 --2- 172.21.15.60:0/3073789151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f546c103600 0x7f546c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 --2- 172.21.15.60:0/3073789151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c102580 0x7f546c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 -- 172.21.15.60:0/3073789151 >> 172.21.15.60:0/3073789151 conn(0x7f546c0fdee0 msgr2=0x7f546c100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 -- 172.21.15.60:0/3073789151 shutdown_connections 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.439+0000 7f5472b20640 1 -- 172.21.15.60:0/3073789151 wait complete. 2024-09-21T07:59:47.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 Processor -- start 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 -- start start 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 0x7f546c06afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c103600 0x7f546c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f546c103fa0 0x7f546c1a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f546c10e200 con 0x7f546c102580 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f546c10e080 con 0x7f546c103600 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f5472b20640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f546c10e380 con 0x7f546c103fa0 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 0x7f546c06afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 0x7f546c06afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36748/0 (socket says 172.21.15.60:36748) 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 -- 172.21.15.60:0/1575584646 learned_addr learned my addr 172.21.15.60:0/1575584646 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f546bfff640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c103600 0x7f546c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54710bd640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f546c103fa0 0x7f546c1a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 -- 172.21.15.60:0/1575584646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f546c103fa0 msgr2=0x7f546c1a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f546c103fa0 0x7f546c1a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 -- 172.21.15.60:0/1575584646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c103600 msgr2=0x7f546c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c103600 0x7f546c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 -- 172.21.15.60:0/1575584646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c1a1960 con 0x7f546c102580 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.440+0000 7f54708bc640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 0x7f546c06afd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f546400e9f0 tx=0x7f546400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.441+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400cd80 con 0x7f546c102580 2024-09-21T07:59:47.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.441+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54640108e0 con 0x7f546c102580 2024-09-21T07:59:47.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.441+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546c1a1c50 con 0x7f546c102580 2024-09-21T07:59:47.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.441+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464018980 con 0x7f546c102580 2024-09-21T07:59:47.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.441+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546c1a21a0 con 0x7f546c102580 2024-09-21T07:59:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.442+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546c109730 con 0x7f546c102580 2024-09-21T07:59:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.444+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f5464010430 con 0x7f546c102580 2024-09-21T07:59:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.444+0000 7f5469ffb640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54580b6510 0x7f54580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.444+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f54640e7a70 con 0x7f546c102580 2024-09-21T07:59:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.444+0000 7f546bfff640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54580b6510 0x7f54580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.445+0000 7f546bfff640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54580b6510 0x7f54580b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f545400bbe0 tx=0x7f545400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.448+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f54640b2710 con 0x7f546c102580 2024-09-21T07:59:47.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.636+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f546c063fc0 con 0x7f546c102580 2024-09-21T07:59:47.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.637+0000 7f5469ffb640 1 -- 172.21.15.60:0/1575584646 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f54640b7650 con 0x7f546c102580 2024-09-21T07:59:47.639 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54580b6510 msgr2=0x7f54580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54580b6510 0x7f54580b8a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f545400bbe0 tx=0x7f545400b390 comp rx=0 tx=0).stop 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 msgr2=0x7f546c06afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 0x7f546c06afd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f546400e9f0 tx=0x7f546400eeb0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 shutdown_connections 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f54580b6510 0x7f54580b8a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f546c103fa0 0x7f546c1a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f546c103600 0x7f546c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 --2- 172.21.15.60:0/1575584646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f546c102580 0x7f546c06afd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 >> 172.21.15.60:0/1575584646 conn(0x7f546c0fdee0 msgr2=0x7f546c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 shutdown_connections 2024-09-21T07:59:47.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.639+0000 7f5472b20640 1 -- 172.21.15.60:0/1575584646 wait complete. 2024-09-21T07:59:47.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.767+0000 7efd41d62640 1 -- 172.21.15.60:0/2037746755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 msgr2=0x7efd3c10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.767+0000 7efd41d62640 1 --2- 172.21.15.60:0/2037746755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c10a960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efd34009ca0 tx=0x7efd3402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.767+0000 7efd41d62640 1 -- 172.21.15.60:0/2037746755 shutdown_connections 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 --2- 172.21.15.60:0/2037746755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c10a960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 --2- 172.21.15.60:0/2037746755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c103620 0x7efd3c103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 --2- 172.21.15.60:0/2037746755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c1025a0 0x7efd3c102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 -- 172.21.15.60:0/2037746755 >> 172.21.15.60:0/2037746755 conn(0x7efd3c0fdee0 msgr2=0x7efd3c100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 -- 172.21.15.60:0/2037746755 shutdown_connections 2024-09-21T07:59:47.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 -- 172.21.15.60:0/2037746755 wait complete. 2024-09-21T07:59:47.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 Processor -- start 2024-09-21T07:59:47.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.768+0000 7efd41d62640 1 -- start start 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd41d62640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 0x7efd3c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd41d62640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c103620 0x7efd3c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd41d62640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd41d62640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c10e240 con 0x7efd3c103fc0 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd41d62640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c10e0c0 con 0x7efd3c103620 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd41d62640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c10e3c0 con 0x7efd3c1025a0 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 0x7efd3c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36766/0 (socket says 172.21.15.60:36766) 2024-09-21T07:59:47.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 -- 172.21.15.60:0/2211003220 learned_addr learned my addr 172.21.15.60:0/2211003220 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 0x7efd3c198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.60:60178/0 (socket says 172.21.15.60:60178) 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3affd640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c103620 0x7efd3c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 -- 172.21.15.60:0/2211003220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 msgr2=0x7efd3c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 0x7efd3c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 -- 172.21.15.60:0/2211003220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c103620 msgr2=0x7efd3c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c103620 0x7efd3c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 -- 172.21.15.60:0/2211003220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c19a780 con 0x7efd3c103fc0 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3affd640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c103620 0x7efd3c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3b7fe640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 0x7efd3c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.769+0000 7efd3bfff640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c199ff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd34009430 tx=0x7efd340317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.770+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34003bf0 con 0x7efd3c103fc0 2024-09-21T07:59:47.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.770+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd34003d90 con 0x7efd3c103fc0 2024-09-21T07:59:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.770+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3c19aa10 con 0x7efd3c103fc0 2024-09-21T07:59:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.770+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3402fc10 con 0x7efd3c103fc0 2024-09-21T07:59:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.770+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3c1a1010 con 0x7efd3c103fc0 2024-09-21T07:59:47.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.771+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd3c109750 con 0x7efd3c103fc0 2024-09-21T07:59:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.772+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7efd340046a0 con 0x7efd3c103fc0 2024-09-21T07:59:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.774+0000 7efd38ff9640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efd240b6510 0x7efd240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.774+0000 7efd3b7fe640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efd240b6510 0x7efd240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.774+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7efd34108990 con 0x7efd3c103fc0 2024-09-21T07:59:47.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.774+0000 7efd3b7fe640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efd240b6510 0x7efd240b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00afb0 tx=0x7efd2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:47.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.777+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd340cf250 con 0x7efd3c103fc0 2024-09-21T07:59:47.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.984+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd3c063fc0 con 0x7efd3c103fc0 2024-09-21T07:59:47.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.985+0000 7efd38ff9640 1 -- 172.21.15.60:0/2211003220 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7efd340d3630 con 0x7efd3c103fc0 2024-09-21T07:59:47.987 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-09-21T07:59:47.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efd240b6510 msgr2=0x7efd240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efd240b6510 0x7efd240b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00afb0 tx=0x7efd2c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 msgr2=0x7efd3c199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:47.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c199ff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efd34009430 tx=0x7efd340317c0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 shutdown_connections 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7efd240b6510 0x7efd240b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd3c103fc0 0x7efd3c199ff0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3c103620 0x7efd3c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.988+0000 7efd41d62640 1 --2- 172.21.15.60:0/2211003220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd3c1025a0 0x7efd3c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.989+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 >> 172.21.15.60:0/2211003220 conn(0x7efd3c0fdee0 msgr2=0x7efd3c106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.989+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 shutdown_connections 2024-09-21T07:59:47.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:47.989+0000 7efd41d62640 1 -- 172.21.15.60:0/2211003220 wait complete. 2024-09-21T07:59:48.008 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:59:48.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 -- 172.21.15.60:0/2315033311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 msgr2=0x7faf14103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 --2- 172.21.15.60:0/2315033311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf14103a30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7faf08009900 tx=0x7faf0802a410 comp rx=0 tx=0).stop 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 -- 172.21.15.60:0/2315033311 shutdown_connections 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 --2- 172.21.15.60:0/2315033311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf14103fc0 0x7faf1410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 --2- 172.21.15.60:0/2315033311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf14103a30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 --2- 172.21.15.60:0/2315033311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf141025a0 0x7faf14102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 -- 172.21.15.60:0/2315033311 >> 172.21.15.60:0/2315033311 conn(0x7faf140fdee0 msgr2=0x7faf14100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 -- 172.21.15.60:0/2315033311 shutdown_connections 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.135+0000 7faf19838640 1 -- 172.21.15.60:0/2315033311 wait complete. 2024-09-21T07:59:48.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 Processor -- start 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 -- start start 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf141025a0 0x7faf1406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf1419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf14103fc0 0x7faf141a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf1410e1e0 con 0x7faf14103620 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf1410e060 con 0x7faf141025a0 2024-09-21T07:59:48.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.136+0000 7faf19838640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7faf1410e360 con 0x7faf14103fc0 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf1419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf1419ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36774/0 (socket says 172.21.15.60:36774) 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 -- 172.21.15.60:0/2875864823 learned_addr learned my addr 172.21.15.60:0/2875864823 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf137fe640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf14103fc0 0x7faf141a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf12ffd640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf141025a0 0x7faf1406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 -- 172.21.15.60:0/2875864823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf14103fc0 msgr2=0x7faf141a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf14103fc0 0x7faf141a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 -- 172.21.15.60:0/2875864823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf141025a0 msgr2=0x7faf1406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf141025a0 0x7faf1406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 -- 172.21.15.60:0/2875864823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf141a19b0 con 0x7faf14103620 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf127fc640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf1419ecf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faf08006010 tx=0x7faf08004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:48.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0803f030 con 0x7faf14103620 2024-09-21T07:59:48.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf08003cb0 con 0x7faf14103620 2024-09-21T07:59:48.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf141a1c40 con 0x7faf14103620 2024-09-21T07:59:48.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08035070 con 0x7faf14103620 2024-09-21T07:59:48.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.137+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf141a2180 con 0x7faf14103620 2024-09-21T07:59:48.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.138+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf14109750 con 0x7faf14103620 2024-09-21T07:59:48.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.140+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7faf08042030 con 0x7faf14103620 2024-09-21T07:59:48.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.141+0000 7faf18836640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faefc0b6590 0x7faefc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.141+0000 7faf12ffd640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faefc0b6590 0x7faefc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.141+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7faf08107f10 con 0x7faf14103620 2024-09-21T07:59:48.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.142+0000 7faf12ffd640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faefc0b6590 0x7faefc0b8aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf0400bbe0 tx=0x7faf0400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:48.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.144+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf08003e60 con 0x7faf14103620 2024-09-21T07:59:48.363 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2024-09-21T07:59:48.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.359+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faf1402e640 con 0x7faf14103620 2024-09-21T07:59:48.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.360+0000 7faf18836640 1 -- 172.21.15.60:0/2875864823 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7faf080d2bb0 con 0x7faf14103620 2024-09-21T07:59:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:48 smithi060 ceph-mon[31244]: pgmap v1093: 97 pgs: 97 active+clean; 444 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-09-21T07:59:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:48 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/257328253' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:48 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1575584646' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:59:48.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:48 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2211003220' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:59:48.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.368+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faefc0b6590 msgr2=0x7faefc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.368+0000 7faf19838640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faefc0b6590 0x7faefc0b8aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf0400bbe0 tx=0x7faf0400b390 comp rx=0 tx=0).stop 2024-09-21T07:59:48.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.368+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 msgr2=0x7faf1419ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.368+0000 7faf19838640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf1419ecf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faf08006010 tx=0x7faf08004340 comp rx=0 tx=0).stop 2024-09-21T07:59:48.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.369+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 shutdown_connections 2024-09-21T07:59:48.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.369+0000 7faf19838640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7faefc0b6590 0x7faefc0b8aa0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf0400bbe0 tx=0x7faf0400b390 comp rx=0 tx=0).stop 2024-09-21T07:59:48.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.369+0000 7faf19838640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf14103fc0 0x7faf141a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.369+0000 7faf19838640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf14103620 0x7faf1419ecf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.369+0000 7faf19838640 1 --2- 172.21.15.60:0/2875864823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf141025a0 0x7faf1406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.369+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 >> 172.21.15.60:0/2875864823 conn(0x7faf140fdee0 msgr2=0x7faf14106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:48.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.370+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 shutdown_connections 2024-09-21T07:59:48.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.372+0000 7faf19838640 1 -- 172.21.15.60:0/2875864823 wait complete. 2024-09-21T07:59:48.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T07:59:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:48 smithi187 ceph-mon[34367]: pgmap v1093: 97 pgs: 97 active+clean; 444 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-09-21T07:59:48.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:48 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/257328253' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:48.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:48 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1575584646' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:59:48.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:48 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2211003220' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 -- 172.21.15.60:0/848807990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 msgr2=0x7f35d8102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 --2- 172.21.15.60:0/848807990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8102a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009900 tx=0x7f35d402a410 comp rx=0 tx=0).stop 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 -- 172.21.15.60:0/848807990 shutdown_connections 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 --2- 172.21.15.60:0/848807990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d8103fe0 0x7f35d810a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 --2- 172.21.15.60:0/848807990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 0x7f35d8103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 --2- 172.21.15.60:0/848807990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8102a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 -- 172.21.15.60:0/848807990 >> 172.21.15.60:0/848807990 conn(0x7f35d80fdf00 msgr2=0x7f35d81003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:48.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 -- 172.21.15.60:0/848807990 shutdown_connections 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.549+0000 7f35df990640 1 -- 172.21.15.60:0/848807990 wait complete. 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 Processor -- start 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 -- start start 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 0x7f35d8199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d8103fe0 0x7f35d819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35d810e1e0 con 0x7f35d8103fe0 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35d810e060 con 0x7f35d81025c0 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35df990640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f35d810e360 con 0x7f35d8103640 2024-09-21T07:59:48.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35dd72c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35ddf2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d8103fe0 0x7f35d819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35dcf2b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 0x7f35d8199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35dd72c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.60:59260/0 (socket says 172.21.15.60:59260) 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.550+0000 7f35dd72c640 1 -- 172.21.15.60:0/2549479783 learned_addr learned my addr 172.21.15.60:0/2549479783 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35dcf2b640 1 -- 172.21.15.60:0/2549479783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 msgr2=0x7f35d8198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35dcf2b640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35dcf2b640 1 -- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d8103fe0 msgr2=0x7f35d819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35dcf2b640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d8103fe0 0x7f35d819a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35dcf2b640 1 -- 172.21.15.60:0/2549479783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d819a8e0 con 0x7f35d8103640 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35dcf2b640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 0x7f35d8199510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f35c800e9f0 tx=0x7f35c800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c800ccc0 con 0x7f35d8103640 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d819abd0 con 0x7f35d8103640 2024-09-21T07:59:48.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35c80108e0 con 0x7f35d8103640 2024-09-21T07:59:48.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8018840 con 0x7f35d8103640 2024-09-21T07:59:48.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.551+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d81a12c0 con 0x7f35d8103640 2024-09-21T07:59:48.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.552+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d8109790 con 0x7f35d8103640 2024-09-21T07:59:48.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.554+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f35c8010430 con 0x7f35d8103640 2024-09-21T07:59:48.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.555+0000 7f35ce7fc640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f35c40b6510 0x7f35c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:59:48.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.555+0000 7f35dd72c640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f35c40b6510 0x7f35c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:59:48.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.555+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f35c80e7780 con 0x7f35d8103640 2024-09-21T07:59:48.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.556+0000 7f35dd72c640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f35c40b6510 0x7f35c40b8a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35d40096c0 tx=0x7f35d40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:59:48.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.558+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35c80ae040 con 0x7f35d8103640 2024-09-21T07:59:48.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:48 smithi123 ceph-mon[34166]: pgmap v1093: 97 pgs: 97 active+clean; 444 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-09-21T07:59:48.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:48 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/257328253' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:59:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:48 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1575584646' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:59:48.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:48 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2211003220' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:59:48.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.797+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f35d8063fc0 con 0x7f35d8103640 2024-09-21T07:59:48.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.806+0000 7f35ce7fc640 1 -- 172.21.15.60:0/2549479783 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+833523 (secure 0 0 0) 0x7f35c80b2420 con 0x7f35d8103640 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 20, 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout: "active_gid": 14150, 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout: "active_name": "x", 2024-09-21T07:59:48.809 INFO:teuthology.orchestra.run.smithi060.stdout: "active_addrs": { 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2850568081 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2850568081 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:48.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "active_addr": "172.21.15.60:6801/2850568081", 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "active_change": "2024-09-21T07:25:32.507744+0000", 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "available": true, 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "standbys": [ 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "gid": 24118, 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "z", 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.811 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:59:48.812 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.813 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:48.814 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.815 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.816 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.817 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.818 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.820 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2024-09-21T07:59:48.820 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.820 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.820 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.820 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2024-09-21T07:59:48.820 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.822 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.824 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.825 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.827 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:48.828 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2024-09-21T07:59:48.829 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:59:48.830 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.831 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-21T07:59:48.832 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:48.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:59:48.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2024-09-21T07:59:48.835 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.836 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.837 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.838 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.839 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.840 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.840 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:48.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:48.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.840 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.841 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.842 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.843 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.844 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2024-09-21T07:59:48.845 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "read", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap-read" 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.848 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.849 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:59:48.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.851 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.852 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.853 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2024-09-21T07:59:48.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2024-09-21T07:59:48.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.858 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.860 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.862 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.863 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.864 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2024-09-21T07:59:48.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2024-09-21T07:59:48.866 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:59:48.867 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.868 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.873 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.873 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2024-09-21T07:59:48.873 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.874 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.875 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:59:48.876 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.877 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:59:48.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2024-09-21T07:59:48.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2024-09-21T07:59:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nginx": { 2024-09-21T07:59:48.881 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nginx", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nginx container image", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.882 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.883 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:48.886 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.887 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba": { 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.888 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba_metrics": { 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.889 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.890 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.891 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.892 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.893 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.896 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.897 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "grafana_dashboards_path": { 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.898 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2024-09-21T07:59:48.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.900 INFO:teuthology.orchestra.run.smithi060.stdout: "hw_monitoring": { 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hw_monitoring", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.901 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.902 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.903 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.904 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.905 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:48.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.907 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.908 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.909 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:59:48.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2024-09-21T07:59:48.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2024-09-21T07:59:48.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.913 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:59:48.915 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "oob_default_addr": { 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "oob_default_addr", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "169.254.1.1", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.916 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.917 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.918 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.919 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.920 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.921 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.922 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.923 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.924 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.925 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.926 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_keepalive_interval": { 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:59:48.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2024-09-21T07:59:48.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2024-09-21T07:59:48.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.930 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2024-09-21T07:59:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.949 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.951 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.953 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.954 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.955 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.956 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.958 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.962 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.963 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.964 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.965 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:59:48.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "[]", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:59:48.967 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "{}", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:59:48.968 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:59:48.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.970 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.972 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.973 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.975 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.976 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.977 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.978 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:59:48.979 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.980 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.981 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.982 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.983 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:59:48.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:59:48.985 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.986 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.988 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.989 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.990 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.992 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.993 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.994 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.995 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.996 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:48.997 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.998 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:48.999 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.000 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2024-09-21T07:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.004 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.006 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.007 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.008 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.009 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "sso_oauth2": { 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sso_oauth2", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.010 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.011 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.012 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2024-09-21T07:59:49.013 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.014 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.015 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.016 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.018 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.019 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.020 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2024-09-21T07:59:49.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2024-09-21T07:59:49.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2024-09-21T07:59:49.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.024 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.026 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:59:49.027 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.028 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.029 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.030 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.031 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.032 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.033 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.035 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.036 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.037 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.038 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2024-09-21T07:59:49.040 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:59:49.041 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.042 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.043 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2024-09-21T07:59:49.044 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.045 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.048 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.049 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.051 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-21T07:59:49.053 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2024-09-21T07:59:49.054 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2024-09-21T07:59:49.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2024-09-21T07:59:49.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.058 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.059 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.060 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.061 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.062 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.063 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2024-09-21T07:59:49.064 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.065 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.066 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.067 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.068 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.069 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.070 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.072 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2024-09-21T07:59:49.073 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.074 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.075 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.076 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.077 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.081 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.083 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.086 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:59:49.088 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:59:49.089 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.090 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.091 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.092 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.093 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.095 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.097 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.098 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.099 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.100 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.101 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.102 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.103 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.105 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.106 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.109 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.111 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.112 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.113 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.114 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.115 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.116 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.117 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.119 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.120 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.121 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.125 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.126 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.127 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.128 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.129 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.130 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.131 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.132 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.133 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.134 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.135 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.136 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.137 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.138 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.140 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.141 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.142 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.143 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.144 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.145 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.146 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.147 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.148 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.149 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.150 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.151 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.152 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.153 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.154 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2024-09-21T07:59:49.155 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2024-09-21T07:59:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:59:49.170 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.171 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.172 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2024-09-21T07:59:49.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.175 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.177 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.178 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.179 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.180 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:59:49.182 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:59:49.183 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.184 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.185 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.186 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.187 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-21T07:59:49.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.189 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.190 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.191 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.192 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.194 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "max_requests": { 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_requests", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.195 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.196 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.197 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.198 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.199 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.200 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.201 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.202 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.203 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.206 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.208 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.209 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.210 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.211 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.212 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.213 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.214 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.215 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.216 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.218 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.219 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.220 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.221 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2024-09-21T07:59:49.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2024-09-21T07:59:49.223 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.224 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.226 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.227 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.228 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.229 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2024-09-21T07:59:49.230 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.231 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.231 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.231 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.231 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.231 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.233 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2024-09-21T07:59:49.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2024-09-21T07:59:49.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.236 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smb", 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "internal_store_backend": { 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "internal_store_backend", 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.238 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.239 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.240 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.241 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.242 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.243 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.244 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "update_orchestration": { 2024-09-21T07:59:49.245 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "update_orchestration", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.246 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.247 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.248 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.250 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.251 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.252 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.253 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.254 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.255 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.257 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.258 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.259 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.260 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.261 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.262 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.263 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.267 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.268 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.269 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2024-09-21T07:59:49.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.271 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.272 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.273 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.274 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.275 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.276 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.277 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.278 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2024-09-21T07:59:49.279 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:59:49.280 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.281 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.282 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.283 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2024-09-21T07:59:49.285 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2024-09-21T07:59:49.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.287 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.289 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.291 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.292 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.293 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.294 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.295 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.296 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.297 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.298 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2024-09-21T07:59:49.299 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2024-09-21T07:59:49.300 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.302 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.303 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.304 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.305 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.306 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.307 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.308 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.310 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.311 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.312 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.313 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.314 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.315 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.316 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.317 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.319 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:59:49.320 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.321 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2024-09-21T07:59:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.323 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.325 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.326 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.328 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.329 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.330 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.331 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.332 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.333 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:49.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "gid": 24140, 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "y", 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.336 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.337 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.338 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.339 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.340 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.341 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.342 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.343 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.344 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.346 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2024-09-21T07:59:49.347 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.348 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.349 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2024-09-21T07:59:49.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.351 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.353 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.354 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2024-09-21T07:59:49.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2024-09-21T07:59:49.356 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.357 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.360 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:59:49.361 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.362 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.365 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.366 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.368 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "read", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap-read" 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.370 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.373 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.374 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.375 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.377 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.378 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:59:49.379 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.380 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.381 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.382 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2024-09-21T07:59:49.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2024-09-21T07:59:49.384 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.386 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.387 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:59:49.388 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.389 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.390 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:59:49.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.392 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.393 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.394 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2024-09-21T07:59:49.395 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.396 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.397 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nginx": { 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nginx", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nginx container image", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.398 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.399 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2024-09-21T07:59:49.400 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:59:49.401 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.402 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.403 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba": { 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.404 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba_metrics": { 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:59:49.405 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.406 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.407 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.408 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:59:49.409 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2024-09-21T07:59:49.410 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.412 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:59:49.413 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.414 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "grafana_dashboards_path": { 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.415 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.416 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "hw_monitoring": { 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hw_monitoring", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.417 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.418 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.420 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.421 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.422 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.423 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.424 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.425 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:59:49.426 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.427 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.428 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.429 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.430 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2024-09-21T07:59:49.431 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "oob_default_addr": { 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "oob_default_addr", 2024-09-21T07:59:49.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "169.254.1.1", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2024-09-21T07:59:49.433 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.435 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.437 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:59:49.437 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:59:49.438 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.439 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.440 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.441 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2024-09-21T07:59:49.442 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.443 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2024-09-21T07:59:49.444 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:59:49.445 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.812+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f35c40b6510 msgr2=0x7f35c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.812+0000 7f35df990640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f35c40b6510 0x7f35c40b8a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35d40096c0 tx=0x7f35d40314a0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.812+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 msgr2=0x7f35d8199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.812+0000 7f35df990640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 0x7f35d8199510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f35c800e9f0 tx=0x7f35c800edf0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 shutdown_connections 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f35c40b6510 0x7f35c40b8a20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35d8103fe0 0x7f35d819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d8103640 0x7f35d8199510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 --2- 172.21.15.60:0/2549479783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35d81025c0 0x7f35d8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 >> 172.21.15.60:0/2549479783 conn(0x7f35d80fdf00 msgr2=0x7f35d8106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:59:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 shutdown_connections 2024-09-21T07:59:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T07:59:48.813+0000 7f35df990640 1 -- 172.21.15.60:0/2549479783 wait complete. 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.451 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_keepalive_interval": { 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:59:49.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2024-09-21T07:59:49.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2024-09-21T07:59:49.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2024-09-21T07:59:49.455 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.456 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.457 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.458 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.459 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.460 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.461 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.462 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.464 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.465 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2024-09-21T07:59:49.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.468 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.469 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.470 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.471 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.472 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.473 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.475 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:59:49.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:59:49.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.478 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.481 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.482 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.484 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.485 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.486 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.487 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.488 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.489 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.490 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "[]", 2024-09-21T07:59:49.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.492 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "{}", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.493 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.495 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.496 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.497 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:59:49.498 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:59:49.499 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:59:49.500 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.501 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.502 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.505 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.507 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.508 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.509 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.510 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.511 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.512 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.513 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.514 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.515 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.516 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.517 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.519 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.520 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.521 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.522 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.523 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.524 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.525 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.526 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:59:49.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:49.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:49.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.530 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.531 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.532 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "sso_oauth2": { 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sso_oauth2", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.534 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.535 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.536 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.537 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.538 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.540 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.541 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.542 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.544 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.545 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.546 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:59:49.547 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:59:49.548 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.549 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.550 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.551 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.552 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.553 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.554 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.555 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.556 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.558 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.559 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.560 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.561 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.562 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2024-09-21T07:59:49.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2024-09-21T07:59:49.564 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.565 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.568 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.569 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.570 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.571 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.572 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.573 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.574 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.575 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.576 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2024-09-21T07:59:49.577 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.578 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2024-09-21T07:59:49.579 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.580 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.581 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.584 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.585 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.586 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.588 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.589 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.590 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.591 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.592 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.593 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:59:49.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2024-09-21T07:59:49.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.597 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.598 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.599 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.601 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.602 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.603 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.606 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.607 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.609 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:59:49.610 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.611 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:59:49.612 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:59:49.613 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.614 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.615 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.616 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.617 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.618 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.619 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.620 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.621 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.622 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.623 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.624 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.625 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.626 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.627 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.630 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.632 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.633 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.634 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.635 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.636 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.637 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.638 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.639 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.640 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.641 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.641 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.642 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.643 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.645 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.647 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.648 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.649 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.650 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.651 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.654 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.657 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.658 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.659 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.660 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.661 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.662 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.663 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.664 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.665 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.666 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.667 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.667 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.667 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.667 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.667 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.667 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.668 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.668 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.668 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2024-09-21T07:59:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.671 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.672 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.673 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.674 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.674 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.674 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.674 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.675 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.675 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.675 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.675 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.675 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.675 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.676 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.676 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.676 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.676 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.676 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.676 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.677 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.678 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.679 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.680 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.681 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.682 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.683 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.684 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.686 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.687 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.688 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.689 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.690 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.691 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.692 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.693 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.694 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.695 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.696 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.697 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2024-09-21T07:59:49.698 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.699 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-21T07:59:49.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.702 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.704 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.705 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.706 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.707 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.708 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.709 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.710 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2024-09-21T07:59:49.711 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.712 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.714 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.715 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.716 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.717 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.719 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "max_requests": { 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_requests", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.720 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.721 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.722 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.723 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.724 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.725 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.726 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.728 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.729 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.730 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.731 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.732 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.733 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.734 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.735 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.736 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.737 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.738 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.739 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2024-09-21T07:59:49.740 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.741 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.743 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.744 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.745 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2024-09-21T07:59:49.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.747 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.750 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.751 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.752 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.753 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.754 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.755 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.756 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.757 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.758 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.759 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smb", 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.760 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "internal_store_backend": { 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "internal_store_backend", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.761 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.762 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.763 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.764 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.765 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.766 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.767 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "update_orchestration": { 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "update_orchestration", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.768 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.769 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.770 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.771 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.772 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.774 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.775 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.776 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.777 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.778 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.779 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.780 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.782 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.783 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.784 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.785 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.786 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.788 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.790 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.792 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.793 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.794 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.796 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.797 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.798 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.799 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.801 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.802 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.804 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.805 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.806 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.807 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2024-09-21T07:59:49.808 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-21T07:59:49.809 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.810 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.812 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.813 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.815 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.816 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.817 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.818 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.819 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.820 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.821 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.822 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.824 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.825 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.826 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.827 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2024-09-21T07:59:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2024-09-21T07:59:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:59:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2024-09-21T07:59:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "modules": [ 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "dashboard", 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "iostat", 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nfs", 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "restful" 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2024-09-21T07:59:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2024-09-21T07:59:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2024-09-21T07:59:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2024-09-21T07:59:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2024-09-21T07:59:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:59:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "read", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap-read" 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2024-09-21T07:59:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2024-09-21T07:59:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2024-09-21T07:59:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nginx": { 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nginx", 2024-09-21T07:59:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nginx container image", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2024-09-21T07:59:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.922 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:59:49.923 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.924 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.925 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba": { 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:59:49.926 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba_metrics": { 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.928 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2024-09-21T07:59:49.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.930 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.931 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.933 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:59:49.934 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:59:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:59:49.936 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "grafana_dashboards_path": { 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:59:49.937 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.938 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "hw_monitoring": { 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hw_monitoring", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.940 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.941 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2024-09-21T07:59:49.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.944 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.945 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.946 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.947 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.949 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.950 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2024-09-21T07:59:49.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-21T07:59:49.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "oob_default_addr": { 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "oob_default_addr", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "169.254.1.1", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.954 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:59:49.958 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.959 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.960 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.962 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.963 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.964 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_keepalive_interval": { 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.965 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.966 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.969 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.972 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.973 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:49.975 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.976 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.977 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:59:49.978 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.979 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.980 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:49.981 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.983 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.984 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:49.985 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.987 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:59:49.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.989 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.991 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.992 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.993 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.994 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.996 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.998 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:49.999 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.000 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.001 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.002 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.004 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "[]", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.005 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "{}", 2024-09-21T07:59:50.006 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.007 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.008 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:59:50.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:59:50.010 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.012 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.013 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.014 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.015 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.016 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.017 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.018 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:59:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.020 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.022 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.023 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.024 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.025 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.026 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.027 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.028 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.029 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.030 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.031 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.032 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.033 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.034 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-21T07:59:50.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.037 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.038 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.039 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.040 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.041 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.044 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:50.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.046 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.047 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.048 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.049 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "sso_oauth2": { 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sso_oauth2", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.050 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.051 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-21T07:59:50.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.053 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.054 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.055 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.056 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.058 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.059 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.060 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.062 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.063 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.064 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2024-09-21T07:59:50.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:50.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2024-09-21T07:59:50.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.072 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.073 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2024-09-21T07:59:50.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.076 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.078 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.080 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2024-09-21T07:59:50.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:50.083 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.085 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.086 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.087 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.088 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.089 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:59:50.095 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.097 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.098 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.101 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.102 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.103 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.104 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.105 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.106 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.108 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.110 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.111 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.112 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:50.113 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.114 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.115 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.116 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.117 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.118 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.119 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.120 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.121 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.123 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.124 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.125 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.126 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.128 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.132 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.133 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.134 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.135 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.136 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.137 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.138 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.139 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.141 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.144 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.145 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.146 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2024-09-21T07:59:50.147 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.148 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.149 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.151 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.152 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.153 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-21T07:59:50.154 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:59:50.155 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.156 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.158 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.159 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.161 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.162 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.163 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.165 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.166 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.167 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.168 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.169 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.170 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.172 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.173 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.175 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.177 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2024-09-21T07:59:50.178 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.179 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.180 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.181 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.182 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.183 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.184 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.185 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.186 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.187 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.188 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.189 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.190 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.191 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.192 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.193 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.194 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.195 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.197 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2024-09-21T07:59:50.198 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.199 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:59:50.200 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.201 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.203 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.204 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.206 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.207 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.208 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.209 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.210 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2024-09-21T07:59:50.211 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.212 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.216 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.217 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.218 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.219 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.220 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.221 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.222 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.223 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.224 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.225 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.226 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "max_requests": { 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_requests", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2024-09-21T07:59:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2024-09-21T07:59:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2024-09-21T07:59:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2024-09-21T07:59:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2024-09-21T07:59:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smb", 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.276 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "internal_store_backend": { 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "internal_store_backend", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.277 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.278 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.279 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.280 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.281 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.282 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.283 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "update_orchestration": { 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "update_orchestration", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.284 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.285 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.287 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.288 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.289 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.290 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.291 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.293 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.294 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.295 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.296 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.297 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.298 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.300 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.301 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.302 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.303 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.304 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.305 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.306 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.307 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.308 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.309 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.312 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.313 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.315 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.316 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.317 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.318 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.319 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.320 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:59:50.321 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.322 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.323 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.324 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.325 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.326 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.327 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2024-09-21T07:59:50.328 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.329 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.330 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-21T07:59:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2024-09-21T07:59:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2024-09-21T07:59:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-21T07:59:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-21T07:59:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-21T07:59:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "sqlite3_killpoint": { 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "dev", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2024-09-21T07:59:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-21T07:59:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "services": { 2024-09-21T07:59:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "dashboard": "https://172.21.15.60:8443/" 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "always_on_modules": { 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus": [ 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-21T07:59:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific": [ 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-21T07:59:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy": [ 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "reef": [ 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "squid": [ 2024-09-21T07:59:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "last_failure_osd_epoch": 3, 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "active_clients": [ 2024-09-21T07:59:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 4187795353 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "libcephsqlite", 2024-09-21T07:59:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2498656104 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-21T07:59:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 4107796907 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2038424059 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T07:59:50.383 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:59:50.390 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T07:59:50.390 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T07:59:50.391 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:49 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2875864823' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:59:50.391 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:49 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2549479783' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:59:50.392 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:49 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2875864823' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:59:50.392 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:49 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2549479783' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:59:50.392 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:49 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2875864823' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:59:50.392 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:49 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2549479783' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:59:50.413 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:50 smithi060 ceph-mon[31244]: pgmap v1094: 97 pgs: 97 active+clean; 353 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.4 MiB/s wr, 345 op/s 2024-09-21T07:59:50.413 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:50 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:59:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:50 smithi187 ceph-mon[34367]: pgmap v1094: 97 pgs: 97 active+clean; 353 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.4 MiB/s wr, 345 op/s 2024-09-21T07:59:50.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:50 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:59:50.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:50 smithi123 ceph-mon[34166]: pgmap v1094: 97 pgs: 97 active+clean; 353 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.4 MiB/s wr, 345 op/s 2024-09-21T07:59:50.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:50 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:59:50.649 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 441, 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 434, 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 902896, 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 268080, 2024-09-21T07:59:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.062485860, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.031676883, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.036407493, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 434, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.021691954, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000049981 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 902896, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 268080 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 330, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 320, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 219008, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.027723329, 2024-09-21T07:59:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.022164492, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002268002, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 328, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.013852696, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000042233 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 219008 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.000396860, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000316587, 2024-09-21T07:59:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:59:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:59:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:59:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:59:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148744, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 30, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:59:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 968, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T07:59:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 439, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 838077, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 439, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 439, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 838077, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:51.297 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:59:52.049 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T07:59:52.049 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T07:59:52.049 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T07:59:52.049 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T07:59:52.049 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T07:59:52.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T07:59:52.351 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:52.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:52 smithi060 ceph-mon[31244]: pgmap v1095: 97 pgs: 97 active+clean; 341 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2024-09-21T07:59:52.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:52 smithi060 ceph-mon[31244]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:59:52.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:52 smithi187 ceph-mon[34367]: pgmap v1095: 97 pgs: 97 active+clean; 341 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2024-09-21T07:59:52.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:52 smithi187 ceph-mon[34367]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:59:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:52 smithi123 ceph-mon[34166]: pgmap v1095: 97 pgs: 97 active+clean; 341 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 268 op/s 2024-09-21T07:59:52.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:52 smithi123 ceph-mon[34166]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T07:59:52.857 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:59:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:59:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 443, 2024-09-21T07:59:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 438, 2024-09-21T07:59:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 901552, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 270992, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.062504923, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.032011695, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.037798332, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 437, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.018685134, 2024-09-21T07:59:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000042757 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 901552, 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 270992 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:59:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 6, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 336, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3360, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 220160, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.029446029, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.022920688, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.003669019, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 335, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.017419418, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000051998 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 220160 2024-09-21T07:59:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.000390266, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000292788, 2024-09-21T07:59:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:59:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:59:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:59:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:59:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148721, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 30, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-09-21T07:59:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 968, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:59:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 445, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 838921, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 445, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 445, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 838921, 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T07:59:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:52.871 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:59:53.585 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T07:59:53.585 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T07:59:53.585 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T07:59:53.585 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T07:59:53.585 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T07:59:53.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T07:59:53.846 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:54.222 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:54 smithi060 ceph-mon[31244]: pgmap v1096: 97 pgs: 97 active+clean; 313 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 312 op/s 2024-09-21T07:59:54.347 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:59:54.347 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 4, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 4, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3040, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 448, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.003569050, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000057382, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002414647, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3, 2024-09-21T07:59:54.348 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.004204304, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001401434 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 438, 2024-09-21T07:59:54.349 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 433, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 900128, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 268272, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.060014124, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.031484525, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.035281035, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 432, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.016751068, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000038775 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.350 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 900128, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 268272 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 331, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 320, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 219184, 2024-09-21T07:59:54.351 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.027566974, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.023012912, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.001582866, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 329, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.013438394, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000040846 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:54.352 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 219184 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:59:54.353 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:59:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T07:59:54.355 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148704, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 29, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:59:54.356 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T07:59:54.357 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 968, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 440, 2024-09-21T07:59:54.358 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 838207, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 440, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 440, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 838207, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:54.359 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:59:54.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:54 smithi187 ceph-mon[34367]: pgmap v1096: 97 pgs: 97 active+clean; 313 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 312 op/s 2024-09-21T07:59:54.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:54 smithi123 ceph-mon[34166]: pgmap v1096: 97 pgs: 97 active+clean; 313 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 312 op/s 2024-09-21T07:59:55.030 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T07:59:55.030 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T07:59:55.030 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T07:59:55.030 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T07:59:55.030 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T07:59:55.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T07:59:55.342 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:59:55.863 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T07:59:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:59:55.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 448, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 441, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 904864, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 272080, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.064262457, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.031935473, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.039158118, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:55.864 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 441, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.021339721, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000048389 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 904864, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 272080 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:59:55.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 335, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 320, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 219888, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.027127824, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.022378747, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.001957944, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 333, 2024-09-21T07:59:55.866 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.012888722, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000038704 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 219888 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:59:55.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.000392808, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000305553, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:55.868 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T07:59:55.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:59:55.870 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:59:55.871 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148704, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 29, 2024-09-21T07:59:55.872 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T07:59:55.873 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 968, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T07:59:55.874 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 446, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 839051, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 446, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 446, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 839051, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T07:59:55.875 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T07:59:56.485 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:56 smithi060 ceph-mon[31244]: pgmap v1097: 97 pgs: 97 active+clean; 308 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-09-21T07:59:56.514 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T07:59:56.514 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T07:59:56.515 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T07:59:56.515 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T07:59:56.515 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T07:59:56.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T07:59:56.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:56 smithi187 ceph-mon[34367]: pgmap v1097: 97 pgs: 97 active+clean; 308 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-09-21T07:59:56.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:56 smithi123 ceph-mon[34166]: pgmap v1097: 97 pgs: 97 active+clean; 308 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-09-21T07:59:56.849 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:59:57.410 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T07:59:57.410 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:59:57.410 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 393725, 2024-09-21T07:59:57.410 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 670669, 2024-09-21T07:59:57.410 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 75570692, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 751904523, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 47.151494680, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 27.329526878, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 16.588452735, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 4.191908716, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 670672, 2024-09-21T07:59:57.411 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 21.701667881, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000032358 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 832878, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.167740542, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000201 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1012800, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 279968 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:59:57.412 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 416828, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 680233, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 85007751, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 644220819, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 8, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 5, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 39.373552340, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 19.707283004, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 15.842129814, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 4.282010360, 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:57.413 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 680234, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 24.851165260, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000036533 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 855073, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.173732622, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000203 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 688784 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.414 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1415133, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2147583, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 507938094, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 2448274566, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 15, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 8, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 127.629420583, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 72.691658984, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 66.925185375, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 5.613842380, 2024-09-21T07:59:57.415 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2147575, 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 77.620519695, 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000036143 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3108678, 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.554939570, 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000178 2024-09-21T07:59:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 466425840, 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 1857540736 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T07:59:57.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 309286, 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 543.454325679, 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001757125 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 253519, 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 78.282909135, 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000308785 2024-09-21T07:59:57.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 951776, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 948823, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 948823, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 6952.928000773, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.007327950 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T07:59:57.419 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 2953, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 765, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 39, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 48, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 7601, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 3122, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 4479, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 3141, 2024-09-21T07:59:57.420 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 45, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 1093, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 1093, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 4, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 1440397, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 832951, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 2953, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 9, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 11246, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-21T07:59:57.421 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 5, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 16, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 5, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 4, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 234, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:59:57.422 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 10, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 45715, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 567148, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:59:57.423 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 261323, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 121453, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 55664, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 591493 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 205, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 9, 2024-09-21T07:59:57.424 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 1006, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 1112, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 153018, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 151906, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T07:59:57.425 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 5, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 87, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T07:59:57.426 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 719518, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 615525, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 614501, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 105017, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 1024, 2024-09-21T07:59:57.427 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 826, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 698, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 697, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 129, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 9, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 1, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 1313879629, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 1537016755, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 185809, 2024-09-21T07:59:57.428 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1392.776594029, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.007495743 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1429, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 153079, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 151650, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 114, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 497, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 383, 2024-09-21T07:59:57.429 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 7596, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 318881, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 311285, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 1093, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 166071, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 164978, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 176656, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 401489920 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 1207815, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 7677, 2024-09-21T07:59:57.430 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 951776, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 21862, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 15374, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 152925, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 999.480583624, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006535756 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 15091, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 376.199338168, 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.024928721 2024-09-21T07:59:57.431 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T07:59:57.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 353858, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1901.268227570, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005372969 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.433 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.434 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.435 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 119, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.658806018, 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005536185 2024-09-21T07:59:57.436 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T07:59:57.437 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 10, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.012003208, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001200320 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 236609, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 2448.965410892, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.010350263 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 32078, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 225.143801265, 2024-09-21T07:59:57.438 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.007018635 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.439 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 124, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.916035159, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.007387380 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T07:59:57.440 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 298, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 7.570192293, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.025403329 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.441 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4796, 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 26.095722105, 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005441143 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 10, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.025269644, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002526964 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T07:59:57.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 152905, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 966.592610827, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006321523 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.444 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 3, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 2, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 64492, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 64492, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 1516, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.445 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:59:57.446 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:59:57.447 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:59:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 3877384, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 2380, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:59:57.449 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7400, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 152, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 10330548, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 307415, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T07:59:57.450 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 349924, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 1571673092, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 37, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 349924, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 349924, 2024-09-21T07:59:57.451 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1956.313760519, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.005590681 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 349924, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 355540 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 349924, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 3176, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 346748, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T07:59:57.452 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 279, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 691, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 3176, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 188985, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 1451, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 36, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 153355, 2024-09-21T07:59:57.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 1382, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T07:59:57.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T07:59:57.455 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 76, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 12, 2024-09-21T07:59:57.456 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 12, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 4424, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 1761 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T07:59:57.457 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 10, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 151906, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 151906, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:57.458 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 2225682, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 410014972, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 2225682, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2225682, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 410014972, 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:57.459 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:57.460 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 349924, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 1587015598, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 349924, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1587015598, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T07:59:57.461 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 349924, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 349924, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 349924, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 349924, 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:57.462 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 151906, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 15342506, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:57.463 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 151906, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 3176, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 15342506, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x561967f71450": { 2024-09-21T07:59:57.464 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 172512, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 719518, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 1532822451, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 719518, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 185809, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1532649939, 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:57.465 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:57.466 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T07:59:58.226 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 07:59:58 smithi123 ceph-mon[34166]: pgmap v1098: 97 pgs: 97 active+clean; 305 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 3.8 MiB/s wr, 201 op/s 2024-09-21T07:59:58.236 INFO:tasks.check_counter:Daemon mds.b mds.exported=5 2024-09-21T07:59:58.237 INFO:tasks.check_counter:Daemon mds.b mds.imported=5 2024-09-21T07:59:58.237 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=205 2024-09-21T07:59:58.237 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-21T07:59:58.237 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T07:59:58.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T07:59:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:59:58.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 07:59:58 smithi187 ceph-mon[34367]: pgmap v1098: 97 pgs: 97 active+clean; 305 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 3.8 MiB/s wr, 201 op/s 2024-09-21T07:59:58.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 07:59:58 smithi060 ceph-mon[31244]: pgmap v1098: 97 pgs: 97 active+clean; 305 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 3.8 MiB/s wr, 201 op/s 2024-09-21T07:59:58.993 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T07:59:58.993 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:59:58.993 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3797, 2024-09-21T07:59:58.993 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 3798, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 584109625, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 1207138, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 8, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.627525043, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.142082853, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.375880560, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.086269933, 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:58.994 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3796, 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.094186687, 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000024812 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.995 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1700, 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2031, 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 467736554, 2024-09-21T07:59:58.996 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 1220548, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 7, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 6, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.422165676, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.066951268, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.305607904, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.036823820, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2030, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.056222564, 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000027695 2024-09-21T07:59:58.997 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 681472 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 2361, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2348, 2024-09-21T07:59:58.998 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 483781972, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 877495, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.510811455, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.087537490, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.378495802, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.041960510, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2347, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.078680278, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000033523 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:58.999 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 950832, 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 272976 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.000 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 11750, 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.547371182, 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000046584 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T07:59:59.001 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.002 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 153191, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 90753, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 62438, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T07:59:59.003 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 23543, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-21T07:59:59.004 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 4, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 234, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T07:59:59.005 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:59:59.006 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-21T07:59:59.007 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:59:59.008 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T07:59:59.009 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 719230, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-21T07:59:59.010 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 129, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 60, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 1313879629, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 1536844243, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 1536843644, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 719230 2024-09-21T07:59:59.011 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1423, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 153057, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 151634, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 108, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 491, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 383, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 153191, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 154470, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 1279, 2024-09-21T07:59:59.012 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 251604, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 468611072 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 0, 2024-09-21T07:59:59.013 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T07:59:59.014 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.015 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.017 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T07:59:59.018 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.018 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.018 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T07:59:59.019 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.020 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.021 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T07:59:59.022 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T07:59:59.023 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.024 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.025 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.026 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T07:59:59.027 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.028 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 3, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 2, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 2, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 4128, 2024-09-21T07:59:59.029 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:59:59.030 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:59:59.031 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:59:59.032 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 291288, 2024-09-21T07:59:59.033 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 1480, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7400, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 152, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T07:59:59.034 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 107843759, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 797932, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 7392, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 26, 2024-09-21T07:59:59.035 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 4, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 7392, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 7392, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 11.845725091, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001602506 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 7392, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 7393 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 7392, 2024-09-21T07:59:59.036 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 7392, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 4122, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 3267, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-21T07:59:59.037 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 2, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T07:59:59.038 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T07:59:59.039 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 76, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 11, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 11, 2024-09-21T07:59:59.040 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 0, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 2, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 0 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 0, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T07:59:59.041 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:59.042 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 7854, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 1534894576, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 7854, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 7854, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1534894576, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.043 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T07:59:59.044 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 7392, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 1532657487, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 7392, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1532657487, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T07:59:59.045 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 7392, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 7392, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 7392, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 7392, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.046 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-21T07:59:59.047 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55e3e28b1520": { 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T07:59:59.048 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T07:59:59.049 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T07:59:59.050 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T07:59:59.730 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T07:59:59.730 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T07:59:59.730 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T07:59:59.730 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T07:59:59.730 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T07:59:59.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T07:59:59.981 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T08:00:00.446 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:00 smithi123 ceph-mon[34166]: pgmap v1099: 97 pgs: 97 active+clean; 303 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 3.8 MiB/s wr, 179 op/s 2024-09-21T08:00:00.446 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:00 smithi123 ceph-mon[34166]: overall HEALTH_OK 2024-09-21T08:00:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:00 smithi187 ceph-mon[34367]: pgmap v1099: 97 pgs: 97 active+clean; 303 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 3.8 MiB/s wr, 179 op/s 2024-09-21T08:00:00.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:00 smithi187 ceph-mon[34367]: overall HEALTH_OK 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 558449, 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 281400, 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 150722523, 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 51276387, 2024-09-21T08:00:00.586 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 9, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 28.926919139, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 14.094317315, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 20.489972306, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.052034606, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 281398, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 4.312549778, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000015325 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:00.587 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 834726, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.104970063, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000125 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1419, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1634, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 418742, 2024-09-21T08:00:00.588 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 1115241, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 16, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 9, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.123630961, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.062442861, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.060150110, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.006079087, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1633, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.069480096, 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000042547 2024-09-21T08:00:00.589 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2262, 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000395727, 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000174 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 4288, 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 774144 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:00:00.590 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 104083, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 106466, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 34279063, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 18517419, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 7, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 6, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 8.261899498, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 3.790661040, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 5.965468978, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.027116916, 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:00.591 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 106465, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.710940007, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000016070 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 206604, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.030083908, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000145 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 33939776, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 18011664 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.592 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2153, 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.038501980, 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000482351 2024-09-21T08:00:00.593 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2188, 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.081151419, 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000037089 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 101043, 2024-09-21T08:00:00.594 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 2128, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2128, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 10.329493184, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004854085 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 98915, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 11, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-21T08:00:00.595 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 27, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 1, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 26, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 23, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 226, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 7, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 7, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 3, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 104067, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 2235, 2024-09-21T08:00:00.596 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 98915, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 110, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 1, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 1, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 2, 2024-09-21T08:00:00.597 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 726, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 211860109, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:00:00.598 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 10, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 2005, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 949, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 626, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 354, 2024-09-21T08:00:00.599 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 2201 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 135, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 1204, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 653, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 1118, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 138, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 7, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 531, 2024-09-21T08:00:00.600 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 524, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:00:00.601 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 1, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_started": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_succeeded": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "uninline_write_failed": 0 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 3282, 2024-09-21T08:00:00.602 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 3282, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 6, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 6, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 2, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-21T08:00:00.603 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 8643103, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 949, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 6.402034668, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006746085 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 31, 2024-09-21T08:00:00.604 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 665, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 634, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 34, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 605, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 571, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 27, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 781, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 754, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 6, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 539, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 533, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 126396, 2024-09-21T08:00:00.605 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 332279808 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 103068, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 11, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 101043, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 24, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 630, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 529, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 7.737168867, 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.014626028 2024-09-21T08:00:00.606 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-21T08:00:00.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 457, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.122131594, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000267246 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.608 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.609 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-21T08:00:00.610 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.610 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.610 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.610 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.610 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-21T08:00:00.610 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.611 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 611, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.268608820, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000439621 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-21T08:00:00.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.614 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.615 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-21T08:00:00.616 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.617 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.618 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 531, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 2.201583903, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004146109 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.619 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 2, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 1, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 252, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 252, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 1455, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.620 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:00:00.621 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:00:00.622 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:00:00.623 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 345633, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 146, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 88, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 1, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:00:00.624 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7400, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 152, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 148360, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2288, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T08:00:00.625 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 2638, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 4610068, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 29, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 2638, 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-21T08:00:00.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2638, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 13.155696476, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004986996 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2638, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 3064 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 2638, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 306, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 2332, 2024-09-21T08:00:00.627 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 10, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 306, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 1255, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 215, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-21T08:00:00.628 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 537, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 20, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-21T08:00:00.629 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-21T08:00:00.630 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 76, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 12, 2024-09-21T08:00:00.631 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 13, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 1, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 568, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 153 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-21T08:00:00.632 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 7, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 7, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 524, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 524, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T08:00:00.633 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 663947, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 121351450, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 663947, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 663947, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 121351450, 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T08:00:00.634 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T08:00:00.635 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 2638, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 4662992, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2638, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 4662992, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.636 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 2638, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 2638, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2638, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 2638, 2024-09-21T08:00:00.637 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 524, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 52924, 2024-09-21T08:00:00.638 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 524, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 306, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 52924, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.639 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x56014d6f1450": { 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 4457, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 3282, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 4448799, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 3282, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T08:00:00.640 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 949, 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 4444342, 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "trackedop": { 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:00.641 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T08:00:00.642 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:00 smithi060 ceph-mon[31244]: pgmap v1099: 97 pgs: 97 active+clean; 303 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 3.8 MiB/s wr, 179 op/s 2024-09-21T08:00:00.642 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:00 smithi060 ceph-mon[31244]: overall HEALTH_OK 2024-09-21T08:00:01.395 INFO:tasks.check_counter:Daemon mds.h mds.exported=1 2024-09-21T08:00:01.395 INFO:tasks.check_counter:Daemon mds.h mds.imported=1 2024-09-21T08:00:01.395 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=135 2024-09-21T08:00:01.396 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=1204 2024-09-21T08:00:01.396 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T08:00:01.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T08:00:01.640 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T08:00:02.156 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-21T08:00:02.156 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:00:02.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 0, 2024-09-21T08:00:02.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2, 2024-09-21T08:00:02.156 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 0, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 0, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.001118398, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.000286249, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:02.157 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 447, 2024-09-21T08:00:02.158 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 442, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 902640, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 273552, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.055092177, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.025806156, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.039219784, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 441, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.016279451, 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000036914 2024-09-21T08:00:02.159 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 902640, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 273552 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 6, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 339, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3360, 2024-09-21T08:00:02.160 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 220688, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.020587809, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.015044027, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.003133745, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 338, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.017950676, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000053108 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:02.161 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 220688 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:00:02.162 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:00:02.163 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-21T08:00:02.164 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 148704, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 29, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:00:02.165 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 968, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-21T08:00:02.166 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 449, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 839441, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 449, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 449, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 839441, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-21T08:00:02.167 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-21T08:00:02.168 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-21T08:00:02.168 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:02.168 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-21T08:00:02.168 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-21T08:00:02.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:02 smithi123 ceph-mon[34166]: pgmap v1100: 97 pgs: 97 active+clean; 303 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.1 MiB/s wr, 129 op/s 2024-09-21T08:00:02.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:02 smithi060 ceph-mon[31244]: pgmap v1100: 97 pgs: 97 active+clean; 303 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.1 MiB/s wr, 129 op/s 2024-09-21T08:00:02.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:02 smithi187 ceph-mon[34367]: pgmap v1100: 97 pgs: 97 active+clean; 303 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.1 MiB/s wr, 129 op/s 2024-09-21T08:00:02.772 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T08:00:02.772 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T08:00:02.773 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T08:00:02.773 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T08:00:02.773 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T08:00:02.773 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T08:00:03.037 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 5019, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 5020, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 5851293, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 1595731, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 6, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 2, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.410691861, 2024-09-21T08:00:03.589 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.176291015, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.089045172, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.121618626, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5018, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.148049266, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000029503 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.590 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 465, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 450, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 954268, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 273962, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 3, 2024-09-21T08:00:03.591 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 2, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.061486186, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.029775485, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.040688390, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000063615, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 450, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.023043816, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000051208 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.592 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 953712, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 273264 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 3, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 336, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 588, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 773454, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 6, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 3, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.019649262, 2024-09-21T08:00:03.593 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.015245056, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.002072428, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000025105, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 334, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.013946794, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000041756 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.594 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 773136 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8499, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.196351714, 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000023102 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 0, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 0, 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2024-09-21T08:00:03.596 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2024-09-21T08:00:03.597 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 536, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 536, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 536, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 1, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 0, 2024-09-21T08:00:03.598 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 0, 2024-09-21T08:00:03.599 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 0, 2024-09-21T08:00:03.600 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 0 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 0, 2024-09-21T08:00:03.601 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:00:03.602 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_started": 0, 2024-09-21T08:00:03.603 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_succeeded": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_write_failed": 0 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "evlrg": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 3278, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2024-09-21T08:00:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 6, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "segmjr": 2, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 8638646, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 8636569, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 3278 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.605 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 18, 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 551, 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 533, 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 6, 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 19, 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 13, 2024-09-21T08:00:03.606 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 536, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 553, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 17, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 0, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 0, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 0, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 120104, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 318517248 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 0, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 0, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 0, 2024-09-21T08:00:03.607 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 0, 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 0, 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.608 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2024-09-21T08:00:03.609 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.610 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2024-09-21T08:00:03.611 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2024-09-21T08:00:03.612 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.613 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.613 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.613 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2024-09-21T08:00:03.614 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.615 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.616 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.617 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2024-09-21T08:00:03.618 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.620 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2024-09-21T08:00:03.621 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 1, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 2, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 1, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 2, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 0, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 0, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 4105, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "mdthresh_evicted": 0 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:00:03.622 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:00:03.623 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2024-09-21T08:00:03.624 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 182474, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 59, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2024-09-21T08:00:03.625 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 7400, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 152, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2024-09-21T08:00:03.626 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 415645, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 3529, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 5021, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 21, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 3, 2024-09-21T08:00:03.627 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 5021, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5021, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 3.581947524, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000713393 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5021, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 5022 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 5021, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 5021, 2024-09-21T08:00:03.628 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 3138, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 1881, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2024-09-21T08:00:03.629 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 1, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:00:03.630 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2024-09-21T08:00:03.631 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 76, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 2, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 4, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 5, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 1, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 0, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 2, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 0 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.632 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed_ops": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 0, 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2024-09-21T08:00:03.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 5483, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 6285967, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 5483, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 5483, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 6285967, 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:03.634 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 5021, 2024-09-21T08:00:03.635 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 4444347, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 5021, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 4444347, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:03.636 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 5021, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 5021, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 5021, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 5021, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.637 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2024-09-21T08:00:03.638 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x5627170ed2b0": { 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:03.639 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "trackedop": { 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2024-09-21T08:00:03.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:03.641 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T08:00:04.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:04 smithi187 ceph-mon[34367]: pgmap v1101: 97 pgs: 97 active+clean; 300 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 3.8 MiB/s wr, 152 op/s 2024-09-21T08:00:04.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:04 smithi123 ceph-mon[34166]: pgmap v1101: 97 pgs: 97 active+clean; 300 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 3.8 MiB/s wr, 152 op/s 2024-09-21T08:00:04.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:04 smithi060 ceph-mon[31244]: pgmap v1101: 97 pgs: 97 active+clean; 300 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 3.8 MiB/s wr, 152 op/s 2024-09-21T08:00:04.706 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T08:00:04.706 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T08:00:04.706 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T08:00:04.706 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-21T08:00:04.706 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T08:00:04.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T08:00:04.960 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 1470, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 1470, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 12967001, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 466700, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 8, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 3, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.135333859, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.055970741, 2024-09-21T08:00:05.530 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.037577895, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.031468365, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1469, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.047337394, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000032224 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T08:00:05.531 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 1669, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 2003, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 17193272, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 1305055, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 7, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 5, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.165824025, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.073034601, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.039885690, 2024-09-21T08:00:05.532 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.041228161, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2001, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.054289873, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000027131 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 774944 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.533 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 2628, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 2615, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 10455277, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 962880, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 5, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.282006968, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.121336727, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.094378613, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.061191377, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2614, 2024-09-21T08:00:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.090381736, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000034576 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 950944, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 273456 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2024-09-21T08:00:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8950, 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.211053990, 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000023581 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2024-09-21T08:00:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 0, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 0, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 5544, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 5544, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 0, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 5544, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 1, 2024-09-21T08:00:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 1, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 0, 2024-09-21T08:00:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:00:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 0, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 0 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2024-09-21T08:00:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0, 2024-09-21T08:00:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_started": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_succeeded": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_write_failed": 0 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "evlrg": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 30419, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2024-09-21T08:00:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 40, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "segmjr": 4, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 42376589, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 42375451, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 30419 2024-09-21T08:00:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 43, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 5565, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 5522, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 11, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 32, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 21, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 5544, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 5620, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 76, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 0, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 0, 2024-09-21T08:00:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 126372, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 324943872 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2024-09-21T08:00:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2024-09-21T08:00:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2024-09-21T08:00:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 1, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 3, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 2, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 2, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 0, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 0, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 4107, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "mdthresh_evicted": 0 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:00:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2024-09-21T08:00:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:00:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 225205, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 103, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:00:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 7400, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 152, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 3888294, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 26263, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2024-09-21T08:00:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 5301, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 21, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 3, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 5301, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5301, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 4.423935496, 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000834547 2024-09-21T08:00:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5301, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 5302 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 5301, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 5301, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 0, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 3142, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 0, 2024-09-21T08:00:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 2157, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 1, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 0, 2024-09-21T08:00:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2024-09-21T08:00:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 76, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2024-09-21T08:00:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 2, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 9, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 10, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 1, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 0, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 2, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 0 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 0, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2024-09-21T08:00:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed_ops": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 5763, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 40070116, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 5763, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 5763, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 40070116, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 5301, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 38183696, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 5301, 2024-09-21T08:00:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 38183696, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 5301, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 5301, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 5301, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 5301, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:05.575 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.576 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x55b6ef2a5380": { 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2024-09-21T08:00:05.577 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: "trackedop": { 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T08:00:06.414 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T08:00:06.415 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T08:00:06.415 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T08:00:06.415 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T08:00:06.415 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T08:00:06.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T08:00:06.424 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:06 smithi060 ceph-mon[31244]: pgmap v1102: 97 pgs: 97 active+clean; 295 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 2.7 MiB/s wr, 107 op/s 2024-09-21T08:00:06.437 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:06 smithi187 ceph-mon[34367]: pgmap v1102: 97 pgs: 97 active+clean; 295 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 2.7 MiB/s wr, 107 op/s 2024-09-21T08:00:06.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:06 smithi123 ceph-mon[34166]: pgmap v1102: 97 pgs: 97 active+clean; 295 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 2.7 MiB/s wr, 107 op/s 2024-09-21T08:00:06.661 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:00:07.178 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 148635, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 175526, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 49227844, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 90048954, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 11, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 13.283250682, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 6.500101273, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 8.924816740, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.207153025, 2024-09-21T08:00:07.179 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 175524, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 3.105573176, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000017693 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 301159, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.041870492, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000139 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 47567072, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 66897408 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.180 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 6799, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 6898, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 2524816, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 15546538, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 12, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 6, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.649610522, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.291991399, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.193419958, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.156789896, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 6898, 2024-09-21T08:00:07.181 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.236236686, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000034247 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2261, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000372017, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000164 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 963840, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 278176 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 568554, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 305809, 2024-09-21T08:00:07.182 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 153899296, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 59223066, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 9, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 6, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 28.679048701, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 12.725336674, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 22.117577627, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.133916591, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 305807, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 4.621127141, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000015111 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.183 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 861155, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.111403276, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000129 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 774784 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2024-09-21T08:00:07.184 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 17296, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 9.468660040, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000547447 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10706, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.558980759, 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000052211 2024-09-21T08:00:07.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 128767, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 30454, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 30454, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 124.281329830, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004080952 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 98313, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 0, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2024-09-21T08:00:07.186 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 11, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 47, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 2, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 45, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 0, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 43, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 226, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 17, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 17, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 3, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 166087, 2024-09-21T08:00:07.187 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 33885, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 98312, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 106, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 1135, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 4, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 4, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 14, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 0, 2024-09-21T08:00:07.188 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 726, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 211860109, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T08:00:07.189 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 0, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 0, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 336, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 19915, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 7149, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 3551, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 1155, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 30463 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 448, 2024-09-21T08:00:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 576, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 339, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 482, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 465, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 15, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 5534, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 5519, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2024-09-21T08:00:07.191 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_quiesce_path": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_quiesce_inode": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 4, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_started": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_succeeded": 0, 2024-09-21T08:00:07.192 INFO:teuthology.orchestra.run.smithi187.stdout: "uninline_write_failed": 0 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "evlrg": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 30440, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 30440, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 40, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 40, 2024-09-21T08:00:07.193 INFO:teuthology.orchestra.run.smithi187.stdout: "segmjr": 4, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 42398603, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 0, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8540, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 43.608699081, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.005106405 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 0 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.194 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 42, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 5668, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 5626, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 34, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 286, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 252, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 38, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 7803, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 7765, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 17, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 5807, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 5790, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 129304, 2024-09-21T08:00:07.195 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 336474112 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 154640, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 11, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 128767, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 862, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 7091, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5520, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 81.128173735, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.014697132 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2024-09-21T08:00:07.196 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 159, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.105156657, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000661362 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 7352, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 8.165012136, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001110583 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000254951, 2024-09-21T08:00:07.198 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000127475 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.201 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10425, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 4.613105575, 2024-09-21T08:00:07.202 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000442504 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1146, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 17.117357236, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.014936611 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2024-09-21T08:00:07.203 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2024-09-21T08:00:07.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 12, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.058333682, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004861140 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 304, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.157637790, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000518545 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.206 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5534, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 12.936298068, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002337603 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.207 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 1, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 3, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 2, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 1, 2024-09-21T08:00:07.208 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 3486, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 3486, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 1528, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "mdthresh_evicted": 0 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:00:07.209 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:00:07.210 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:00:07.211 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 445501, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 182, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 88, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 1, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 7400, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 152, 2024-09-21T08:00:07.212 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 226049, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 5642, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2024-09-21T08:00:07.213 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 16398, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 39358031, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 28, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 16398, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 16398, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 92.746663474, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.005655974 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 16398, 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 17338 2024-09-21T08:00:07.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 16398, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 655, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 15743, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 0, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 10, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 655, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 9195, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 394, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2024-09-21T08:00:07.215 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 5540, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 20, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2024-09-21T08:00:07.216 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2024-09-21T08:00:07.217 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 76, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 2, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 12, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 12, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2024-09-21T08:00:07.218 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 1115, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 0, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 409 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 1, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T08:00:07.219 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 10, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed_ops": 5519, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 5519, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 723984, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 134372807, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:07.220 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 723984, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 723984, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 134372807, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:07.221 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 16398, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 39915450, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 16398, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 39915450, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 16398, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 16398, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 16398, 2024-09-21T08:00:07.223 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 16398, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 5519, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 557419, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:07.224 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 5519, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 655, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 557419, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x55a40da4f450": { 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 3594, 2024-09-21T08:00:07.225 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 30440, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 38204299, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 30440, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 8540, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 38200705, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:07.226 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:07.227 INFO:teuthology.orchestra.run.smithi187.stdout: "trackedop": { 2024-09-21T08:00:07.227 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2024-09-21T08:00:07.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:07.227 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T08:00:08.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:08 smithi187 ceph-mon[34367]: pgmap v1103: 97 pgs: 97 active+clean; 285 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.2 MiB/s wr, 128 op/s 2024-09-21T08:00:08.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:08 smithi123 ceph-mon[34166]: pgmap v1103: 97 pgs: 97 active+clean; 285 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.2 MiB/s wr, 128 op/s 2024-09-21T08:00:08.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:08 smithi060 ceph-mon[31244]: pgmap v1103: 97 pgs: 97 active+clean; 285 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.2 MiB/s wr, 128 op/s 2024-09-21T08:00:08.658 INFO:tasks.check_counter:Daemon mds.i mds.exported=4 2024-09-21T08:00:08.659 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2024-09-21T08:00:08.659 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=448 2024-09-21T08:00:08.659 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=576 2024-09-21T08:00:08.659 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T08:00:08.659 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T08:00:09.014 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 449, 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 444, 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 903184, 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 274832, 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 4, 2024-09-21T08:00:09.579 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 0, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.060705504, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.030123160, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.040223700, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 443, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.018376816, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000041482 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:09.580 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 903184, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 274832 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 2, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 339, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 320, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 220592, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 4, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 2, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.020827496, 2024-09-21T08:00:09.581 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.016906609, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.001151619, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 337, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.014558258, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000043199 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:09.582 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 220592 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 4, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 4, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 3040, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 448, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 2, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 1, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.002197384, 2024-09-21T08:00:09.583 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.000028054, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.002129284, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 3, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.003811966, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001270655 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T08:00:09.584 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 0, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T08:00:09.585 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2024-09-21T08:00:09.586 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2024-09-21T08:00:09.587 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 148704, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 29, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2024-09-21T08:00:09.588 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 968, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 2, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2024-09-21T08:00:09.589 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 451, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 839701, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 451, 2024-09-21T08:00:09.590 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 451, 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 839701, 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-09-21T08:00:09.591 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-09-21T08:00:10.223 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T08:00:10.223 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T08:00:10.223 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-21T08:00:10.224 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-21T08:00:10.224 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T08:00:10.234 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T08:00:10.234 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T08:00:10.234 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:00:10.253 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T08:00:10.253 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T08:00:10.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T08:00:10.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:10 smithi187 ceph-mon[34367]: pgmap v1104: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 3.2 MiB/s wr, 131 op/s 2024-09-21T08:00:10.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:10 smithi123 ceph-mon[34166]: pgmap v1104: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 3.2 MiB/s wr, 131 op/s 2024-09-21T08:00:10.611 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:10.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:10 smithi060 ceph-mon[31244]: pgmap v1104: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 3.2 MiB/s wr, 131 op/s 2024-09-21T08:00:11.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 -- 172.21.15.60:0/3501110374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 msgr2=0x7f38b0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/3501110374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b0110630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009900 tx=0x7f38a802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 -- 172.21.15.60:0/3501110374 shutdown_connections 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/3501110374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b0110630 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/3501110374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b01094b0 0x7f38b01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/3501110374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38b0103bc0 0x7f38b0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 -- 172.21.15.60:0/3501110374 >> 172.21.15.60:0/3501110374 conn(0x7f38b007b910 msgr2=0x7f38b007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 -- 172.21.15.60:0/3501110374 shutdown_connections 2024-09-21T08:00:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.157+0000 7f38b5cfc640 1 -- 172.21.15.60:0/3501110374 wait complete. 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.158+0000 7f38b5cfc640 1 Processor -- start 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.158+0000 7f38b5cfc640 1 -- start start 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38b5cfc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38b0103bc0 0x7f38b019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38b5cfc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b01094b0 0x7f38b019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38b5cfc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38b5cfc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0113b70 con 0x7f38b0109e00 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38b5cfc640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38b01139f0 con 0x7f38b01094b0 2024-09-21T08:00:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38b5cfc640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f38b0113cf0 con 0x7f38b0103bc0 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59510/0 (socket says 172.21.15.60:59510) 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 -- 172.21.15.60:0/1354181854 learned_addr learned my addr 172.21.15.60:0/1354181854 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38aeffd640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b01094b0 0x7f38b019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38af7fe640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38b0103bc0 0x7f38b019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 -- 172.21.15.60:0/1354181854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38b0103bc0 msgr2=0x7f38b019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38b0103bc0 0x7f38b019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 -- 172.21.15.60:0/1354181854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b01094b0 msgr2=0x7f38b019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b01094b0 0x7f38b019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 -- 172.21.15.60:0/1354181854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b01a0430 con 0x7f38b0109e00 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38affff640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b019fd00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f38a802a930 tx=0x7f38a8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.159+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a803f070 con 0x7f38b0109e00 2024-09-21T08:00:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.160+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b01a06c0 con 0x7f38b0109e00 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.160+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38a8031d60 con 0x7f38b0109e00 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.160+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8035030 con 0x7f38b0109e00 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.160+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b01a6e80 con 0x7f38b0109e00 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.161+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b0103fd0 con 0x7f38b0109e00 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.162+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f38a8042070 con 0x7f38b0109e00 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.163+0000 7f38acff9640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f38980b6510 0x7f38980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.163+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f38a8107d40 con 0x7f38b0109e00 2024-09-21T08:00:11.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.163+0000 7f38af7fe640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f38980b6510 0x7f38980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:11.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.163+0000 7f38af7fe640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f38980b6510 0x7f38980b8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38a000a400 tx=0x7f38a000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:11.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.166+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38a80d29e0 con 0x7f38b0109e00 2024-09-21T08:00:11.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.373+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f38b019b5f0 con 0x7f38b0109e00 2024-09-21T08:00:11.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.374+0000 7f38acff9640 1 -- 172.21.15.60:0/1354181854 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v76) ==== 81+0+589 (secure 0 0 0) 0x7f38b019b5f0 con 0x7f38b0109e00 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1385204668 2024-09-22T07:25:32.507621+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/510621072 2024-09-22T07:25:32.507621+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2378675823 2024-09-22T07:25:32.507621+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/3227569621 2024-09-22T07:25:05.170700+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/920466350 2024-09-22T07:25:32.507621+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/3227569621 2024-09-22T07:25:05.170700+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2951813751 2024-09-22T07:25:05.170700+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/1994595675 2024-09-22T07:25:05.170700+0000 2024-09-21T08:00:11.376 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/510621072 2024-09-22T07:25:32.507621+0000 2024-09-21T08:00:11.377 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3389403472 2024-09-22T07:25:05.170700+0000 2024-09-21T08:00:11.377 INFO:teuthology.orchestra.run.smithi060.stderr:listed 10 entries 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f38980b6510 msgr2=0x7f38980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f38980b6510 0x7f38980b8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38a000a400 tx=0x7f38a000d040 comp rx=0 tx=0).stop 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 msgr2=0x7f38b019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b019fd00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f38a802a930 tx=0x7f38a8003cd0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 shutdown_connections 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f38980b6510 0x7f38980b8a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38b0109e00 0x7f38b019fd00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b01094b0 0x7f38b019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 --2- 172.21.15.60:0/1354181854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38b0103bc0 0x7f38b019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:11.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 >> 172.21.15.60:0/1354181854 conn(0x7f38b007b910 msgr2=0x7f38b0107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:11.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 shutdown_connections 2024-09-21T08:00:11.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:11.376+0000 7f38b5cfc640 1 -- 172.21.15.60:0/1354181854 wait complete. 2024-09-21T08:00:12.063 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T08:00:12.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:12.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T08:00:12.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:12 smithi060 ceph-mon[31244]: pgmap v1105: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.8 MiB/s wr, 109 op/s 2024-09-21T08:00:12.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:12 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1354181854' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:00:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:12 smithi187 ceph-mon[34367]: pgmap v1105: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.8 MiB/s wr, 109 op/s 2024-09-21T08:00:12.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:12 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1354181854' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:00:12.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:12 smithi123 ceph-mon[34166]: pgmap v1105: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 2.8 MiB/s wr, 109 op/s 2024-09-21T08:00:12.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:12 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1354181854' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T08:00:12.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T08:00:12.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:12.776 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T08:00:12.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:12.837 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-21T08:00:12.875 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T08:00:12.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:12.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T08:00:12.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T08:00:12.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-21T08:00:13.049 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T08:00:13.059 INFO:tasks.cephadm:Teardown begin 2024-09-21T08:00:13.059 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T08:00:13.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:13.380 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/2250655005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 msgr2=0x7f4c541035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/2250655005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c541035e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009900 tx=0x7f4c5002a410 comp rx=0 tx=0).stop 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/2250655005 shutdown_connections 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/2250655005 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 0x7f4c5410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/2250655005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 0x7f4c54108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/2250655005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c541035e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/2250655005 >> 172.21.15.60:0/2250655005 conn(0x7f4c54079e40 msgr2=0x7f4c5407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.841+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/2250655005 shutdown_connections 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.842+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/2250655005 wait complete. 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.842+0000 7f4c5c0d1640 1 Processor -- start 2024-09-21T08:00:13.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.842+0000 7f4c5c0d1640 1 -- start start 2024-09-21T08:00:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5c0d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c5419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5c0d1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 0x7f4c5419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5c0d1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 0x7f4c5419ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5c0d1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54112c20 con 0x7f4c541031d0 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5c0d1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54112aa0 con 0x7f4c54108f60 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5c0d1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54112da0 con 0x7f4c54108610 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c59e6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c5419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c59e6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c5419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59524/0 (socket says 172.21.15.60:59524) 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c59e6d640 1 -- 172.21.15.60:0/4157685438 learned_addr learned my addr 172.21.15.60:0/4157685438 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5a66e640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 0x7f4c5419ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5966c640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 0x7f4c5419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5a66e640 1 -- 172.21.15.60:0/4157685438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 msgr2=0x7f4c5419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5a66e640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 0x7f4c5419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5a66e640 1 -- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 msgr2=0x7f4c5419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5a66e640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c5419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5a66e640 1 -- 172.21.15.60:0/4157685438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c541a0650 con 0x7f4c54108f60 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c59e6d640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c5419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:13.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.843+0000 7f4c5966c640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 0x7f4c5419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.844+0000 7f4c5a66e640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 0x7f4c5419ff20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e940 tx=0x7f4c4c00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.844+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c004d20 con 0x7f4c54108f60 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.844+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c4c005020 con 0x7f4c54108f60 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.844+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c541a0940 con 0x7f4c54108f60 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.844+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c0116d0 con 0x7f4c54108f60 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.844+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c541a70a0 con 0x7f4c54108f60 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.845+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c541035e0 con 0x7f4c54108f60 2024-09-21T08:00:13.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.847+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f4c4c005460 con 0x7f4c54108f60 2024-09-21T08:00:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.847+0000 7f4c4affd640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4c400b6510 0x7f4c400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.847+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f4c4c0e7790 con 0x7f4c54108f60 2024-09-21T08:00:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.847+0000 7f4c59e6d640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4c400b6510 0x7f4c400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:13.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.848+0000 7f4c59e6d640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4c400b6510 0x7f4c400b8a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c50031440 tx=0x7f4c500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:13.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:13.851+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c4c016030 con 0x7f4c54108f60 2024-09-21T08:00:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.078+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c5419b810 con 0x7f4c54108f60 2024-09-21T08:00:14.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.079+0000 7f4c4affd640 1 -- 172.21.15.60:0/4157685438 <== mon.2 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11919 (secure 0 0 0) 0x7f4c5419b810 con 0x7f4c54108f60 2024-09-21T08:00:14.081 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T08:00:14.081 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"btime":"2024-09-21T07:59:51:126318+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:59:51.021519+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24623,24613]},"id":1}]} 2024-09-21T08:00:14.081 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4c400b6510 msgr2=0x7f4c400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4c400b6510 0x7f4c400b8a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c50031440 tx=0x7f4c500058d0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 msgr2=0x7f4c5419ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 0x7f4c5419ff20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e940 tx=0x7f4c4c00ee00 comp rx=0 tx=0).stop 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 shutdown_connections 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f4c400b6510 0x7f4c400b8a20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c54108f60 0x7f4c5419ff20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c54108610 0x7f4c5419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 --2- 172.21.15.60:0/4157685438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c541031d0 0x7f4c5419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 >> 172.21.15.60:0/4157685438 conn(0x7f4c54079e40 msgr2=0x7f4c541012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 shutdown_connections 2024-09-21T08:00:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:14.081+0000 7f4c5c0d1640 1 -- 172.21.15.60:0/4157685438 wait complete. 2024-09-21T08:00:14.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:14 smithi060 ceph-mon[31244]: pgmap v1106: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 4.0 MiB/s wr, 147 op/s 2024-09-21T08:00:14.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:14 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4157685438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:14 smithi187 ceph-mon[34367]: pgmap v1106: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 4.0 MiB/s wr, 147 op/s 2024-09-21T08:00:14.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:14 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4157685438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:14 smithi123 ceph-mon[34166]: pgmap v1106: 97 pgs: 97 active+clean; 275 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 4.0 MiB/s wr, 147 op/s 2024-09-21T08:00:14.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:14 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4157685438' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:14.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T08:00:15.201 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:15.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 -- 172.21.15.60:0/1063663692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c109df0 msgr2=0x7fc33c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 --2- 172.21.15.60:0/1063663692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c109df0 0x7fc33c110620 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc334009ca0 tx=0x7fc33402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 -- 172.21.15.60:0/1063663692 shutdown_connections 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 --2- 172.21.15.60:0/1063663692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c109df0 0x7fc33c110620 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 --2- 172.21.15.60:0/1063663692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33c1094a0 0x7fc33c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 --2- 172.21.15.60:0/1063663692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c103b60 0x7fc33c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 -- 172.21.15.60:0/1063663692 >> 172.21.15.60:0/1063663692 conn(0x7fc33c07b850 msgr2=0x7fc33c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 -- 172.21.15.60:0/1063663692 shutdown_connections 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.654+0000 7fc342571640 1 -- 172.21.15.60:0/1063663692 wait complete. 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 Processor -- start 2024-09-21T08:00:15.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 -- start start 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33c103b60 0x7fc33c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 0x7fc33c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c109df0 0x7fc33c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c113ab0 con 0x7fc33c1094a0 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c113930 con 0x7fc33c103b60 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc342571640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c113c30 con 0x7fc33c109df0 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc33b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 0x7fc33c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc33b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 0x7fc33c19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59530/0 (socket says 172.21.15.60:59530) 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc33b7fe640 1 -- 172.21.15.60:0/1933531340 learned_addr learned my addr 172.21.15.60:0/1933531340 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.655+0000 7fc33bfff640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33c103b60 0x7fc33c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc340b0e640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c109df0 0x7fc33c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc33b7fe640 1 -- 172.21.15.60:0/1933531340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c109df0 msgr2=0x7fc33c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc33b7fe640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c109df0 0x7fc33c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc33b7fe640 1 -- 172.21.15.60:0/1933531340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33c103b60 msgr2=0x7fc33c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc33b7fe640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33c103b60 0x7fc33c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc33b7fe640 1 -- 172.21.15.60:0/1933531340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c1a0390 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc340b0e640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c109df0 0x7fc33c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc33b7fe640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 0x7fc33c19a9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d740 tx=0x7fc33000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330017070 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c1a0680 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc33000de50 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33000f620 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.656+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c1a6de0 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.658+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c103f70 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.659+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc33001a070 con 0x7fc33c1094a0 2024-09-21T08:00:15.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.660+0000 7fc3397fa640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc3240b6510 0x7fc3240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:15.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.660+0000 7fc33bfff640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc3240b6510 0x7fc3240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:15.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.660+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7fc3300e6ce0 con 0x7fc33c1094a0 2024-09-21T08:00:15.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.660+0000 7fc33bfff640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc3240b6510 0x7fc3240b8a20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005fd0 tx=0x7fc32c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:15.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.664+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3300ad5a0 con 0x7fc33c1094a0 2024-09-21T08:00:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.890+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc33c02e640 con 0x7fc33c1094a0 2024-09-21T08:00:15.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.891+0000 7fc3397fa640 1 -- 172.21.15.60:0/1933531340 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11919 (secure 0 0 0) 0x7fc3300b1980 con 0x7fc33c1094a0 2024-09-21T08:00:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T08:00:15.893 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"btime":"2024-09-21T07:59:51:126318+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14709,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2104077895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2104077895},{"type":"v1","addr":"172.21.15.60:6835","nonce":2104077895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14721,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1000584713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1000584713},{"type":"v1","addr":"172.21.15.60:6837","nonce":1000584713}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14772,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/349223669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":349223669},{"type":"v1","addr":"172.21.15.60:6839","nonce":349223669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14778,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/2013963120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":2013963120},{"type":"v1","addr":"172.21.15.60:6841","nonce":2013963120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24544,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/147828917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":147828917},{"type":"v1","addr":"172.21.15.187:6833","nonce":147828917}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/192831616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":192831616},{"type":"v1","addr":"172.21.15.123:6833","nonce":192831616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:32:53.917796+0000","modified":"2024-09-21T07:59:51.021519+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24653,"mds_1":24623,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24586":{"gid":24586,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/1725714173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1725714173},{"type":"v1","addr":"172.21.15.187:6835","nonce":1725714173}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24598":{"gid":24598,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6837/4006232422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":4006232422},{"type":"v1","addr":"172.21.15.187:6837","nonce":4006232422}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/1302227504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1302227504},{"type":"v1","addr":"172.21.15.123:6835","nonce":1302227504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.187:6839/1132397222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1132397222},{"type":"v1","addr":"172.21.15.187:6839","nonce":1132397222}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24623":{"gid":24623,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.123:6837/2557983020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":2557983020},{"type":"v1","addr":"172.21.15.123:6837","nonce":2557983020}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6839/4279563434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":4279563434},{"type":"v1","addr":"172.21.15.123:6839","nonce":4279563434}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653,24623,24613]},"id":1}]} 2024-09-21T08:00:15.893 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc3240b6510 msgr2=0x7fc3240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc3240b6510 0x7fc3240b8a20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005fd0 tx=0x7fc32c00b390 comp rx=0 tx=0).stop 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 msgr2=0x7fc33c19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 0x7fc33c19a9c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc33000d740 tx=0x7fc33000dc00 comp rx=0 tx=0).stop 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 shutdown_connections 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fc3240b6510 0x7fc3240b8a20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c109df0 0x7fc33c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc33c1094a0 0x7fc33c19a9c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 --2- 172.21.15.60:0/1933531340 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33c103b60 0x7fc33c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 >> 172.21.15.60:0/1933531340 conn(0x7fc33c07b850 msgr2=0x7fc33c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 shutdown_connections 2024-09-21T08:00:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:15.893+0000 7fc342571640 1 -- 172.21.15.60:0/1933531340 wait complete. 2024-09-21T08:00:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:16 smithi187 ceph-mon[34367]: pgmap v1107: 97 pgs: 97 active+clean; 273 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-21T08:00:16.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:16 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/1933531340' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:16.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:16 smithi060 ceph-mon[31244]: pgmap v1107: 97 pgs: 97 active+clean; 273 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-21T08:00:16.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:16 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/1933531340' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:16.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T08:00:16.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:16 smithi123 ceph-mon[34166]: pgmap v1107: 97 pgs: 97 active+clean; 273 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-09-21T08:00:16.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:16 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/1933531340' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T08:00:16.840 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:17.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 -- 172.21.15.60:0/530365262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d01052e0 msgr2=0x7f71d010d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/530365262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d01052e0 0x7f71d010d920 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009900 tx=0x7f71c402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 -- 172.21.15.60:0/530365262 shutdown_connections 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/530365262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d010de60 0x7f71d0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/530365262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d01052e0 0x7f71d010d920 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/530365262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71d01048b0 0x7f71d0104cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 -- 172.21.15.60:0/530365262 >> 172.21.15.60:0/530365262 conn(0x7f71d0079750 msgr2=0x7f71d0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.297+0000 7f71d4d2d640 1 -- 172.21.15.60:0/530365262 shutdown_connections 2024-09-21T08:00:17.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.298+0000 7f71d4d2d640 1 -- 172.21.15.60:0/530365262 wait complete. 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.298+0000 7f71d4d2d640 1 Processor -- start 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.298+0000 7f71d4d2d640 1 -- start start 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71d4d2d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d01048b0 0x7f71d019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71d4d2d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71d01052e0 0x7f71d019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71d4d2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 0x7f71d019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71d4d2d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71d0113ae0 con 0x7f71d010de60 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71d4d2d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f71d0113960 con 0x7f71d01052e0 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71d4d2d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f71d0113c60 con 0x7f71d01048b0 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 0x7f71d019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 0x7f71d019fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41418/0 (socket says 172.21.15.60:41418) 2024-09-21T08:00:17.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 -- 172.21.15.60:0/2401981929 learned_addr learned my addr 172.21.15.60:0/2401981929 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71cdd9b640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71d01052e0 0x7f71d019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ce59c640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d01048b0 0x7f71d019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 -- 172.21.15.60:0/2401981929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d01048b0 msgr2=0x7f71d019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d01048b0 0x7f71d019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 -- 172.21.15.60:0/2401981929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71d01052e0 msgr2=0x7f71d019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71d01052e0 0x7f71d019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 -- 172.21.15.60:0/2401981929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d01a0460 con 0x7f71d010de60 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.299+0000 7f71ced9d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 0x7f71d019fdf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71c800b970 tx=0x7f71c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.300+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8019070 con 0x7f71d010de60 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.300+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d01a0750 con 0x7f71d010de60 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.300+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c8014440 con 0x7f71d010de60 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.300+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c80075d0 con 0x7f71d010de60 2024-09-21T08:00:17.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.300+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d01a6f70 con 0x7f71d010de60 2024-09-21T08:00:17.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.301+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d006c1e0 con 0x7f71d010de60 2024-09-21T08:00:17.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.302+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f71c801c070 con 0x7f71d010de60 2024-09-21T08:00:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.303+0000 7f71bf7fe640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b80b6540 0x7f71b80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.303+0000 7f71ce59c640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b80b6540 0x7f71b80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.303+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f71c80e6b90 con 0x7f71d010de60 2024-09-21T08:00:17.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.304+0000 7f71ce59c640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b80b6540 0x7f71b80b8a50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f71d006c8e0 tx=0x7f71c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:17.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.306+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71c80b1830 con 0x7f71d010de60 2024-09-21T08:00:17.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.498+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71d0104cc0 con 0x7f71d010de60 2024-09-21T08:00:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.499+0000 7f71bf7fe640 1 -- 172.21.15.60:0/2401981929 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22654 (secure 0 0 0) 0x7f71d0104cc0 con 0x7f71d010de60 2024-09-21T08:00:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T08:00:17.501 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"679a927c-77ea-11ef-baf5-efdc52797490","created":"2024-09-21T07:24:36.496842+0000","modified":"2024-09-21T07:33:33.924895+0000","last_up_change":"2024-09-21T07:32:06.803230+0000","last_in_change":"2024-09-21T07:31:42.575362+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:28:22.984982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:32:50.091500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:32:51.944737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f3a719ec-ef8e-4f38-902e-2aec93ed6ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6803","nonce":331796551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6805","nonce":331796551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6809","nonce":331796551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":331796551},{"type":"v1","addr":"172.21.15.60:6807","nonce":331796551}]},"public_addr":"172.21.15.60:6803/331796551","cluster_addr":"172.21.15.60:6805/331796551","heartbeat_back_addr":"172.21.15.60:6809/331796551","heartbeat_front_addr":"172.21.15.60:6807/331796551","state":["exists","up"]},{"osd":1,"uuid":"a864067d-8d15-4d06-9ff5-0750ec06bd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6801","nonce":1737463834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6803","nonce":1737463834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6807","nonce":1737463834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":1737463834},{"type":"v1","addr":"172.21.15.123:6805","nonce":1737463834}]},"public_addr":"172.21.15.123:6801/1737463834","cluster_addr":"172.21.15.123:6803/1737463834","heartbeat_back_addr":"172.21.15.123:6807/1737463834","heartbeat_front_addr":"172.21.15.123:6805/1737463834","state":["exists","up"]},{"osd":2,"uuid":"9eb477e9-1e45-45e6-9146-150a9a015d1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6801","nonce":2554805440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6803","nonce":2554805440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6807","nonce":2554805440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2554805440},{"type":"v1","addr":"172.21.15.187:6805","nonce":2554805440}]},"public_addr":"172.21.15.187:6801/2554805440","cluster_addr":"172.21.15.187:6803/2554805440","heartbeat_back_addr":"172.21.15.187:6807/2554805440","heartbeat_front_addr":"172.21.15.187:6805/2554805440","state":["exists","up"]},{"osd":3,"uuid":"74305a81-d848-48b3-936b-ead6ec6cbad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6811","nonce":1306706740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6813","nonce":1306706740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6817","nonce":1306706740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1306706740},{"type":"v1","addr":"172.21.15.60:6815","nonce":1306706740}]},"public_addr":"172.21.15.60:6811/1306706740","cluster_addr":"172.21.15.60:6813/1306706740","heartbeat_back_addr":"172.21.15.60:6817/1306706740","heartbeat_front_addr":"172.21.15.60:6815/1306706740","state":["exists","up"]},{"osd":4,"uuid":"a7c4c148-9290-45d8-a044-058f80bf0492","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6809","nonce":3197471804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6811","nonce":3197471804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6815","nonce":3197471804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3197471804},{"type":"v1","addr":"172.21.15.123:6813","nonce":3197471804}]},"public_addr":"172.21.15.123:6809/3197471804","cluster_addr":"172.21.15.123:6811/3197471804","heartbeat_back_addr":"172.21.15.123:6815/3197471804","heartbeat_front_addr":"172.21.15.123:6813/3197471804","state":["exists","up"]},{"osd":5,"uuid":"8498706f-736f-4998-b5e7-51c3d922e0b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6809","nonce":3494184660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6811","nonce":3494184660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6815","nonce":3494184660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":3494184660},{"type":"v1","addr":"172.21.15.187:6813","nonce":3494184660}]},"public_addr":"172.21.15.187:6809/3494184660","cluster_addr":"172.21.15.187:6811/3494184660","heartbeat_back_addr":"172.21.15.187:6815/3494184660","heartbeat_front_addr":"172.21.15.187:6813/3494184660","state":["exists","up"]},{"osd":6,"uuid":"6853e674-76d8-43c3-a656-f497be510006","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6819","nonce":3398529627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6821","nonce":3398529627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6825","nonce":3398529627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":3398529627},{"type":"v1","addr":"172.21.15.60:6823","nonce":3398529627}]},"public_addr":"172.21.15.60:6819/3398529627","cluster_addr":"172.21.15.60:6821/3398529627","heartbeat_back_addr":"172.21.15.60:6825/3398529627","heartbeat_front_addr":"172.21.15.60:6823/3398529627","state":["exists","up"]},{"osd":7,"uuid":"91b7b6ec-445e-4ac5-991a-4c83fc17703b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6817","nonce":203595290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6819","nonce":203595290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6823","nonce":203595290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":203595290},{"type":"v1","addr":"172.21.15.123:6821","nonce":203595290}]},"public_addr":"172.21.15.123:6817/203595290","cluster_addr":"172.21.15.123:6819/203595290","heartbeat_back_addr":"172.21.15.123:6823/203595290","heartbeat_front_addr":"172.21.15.123:6821/203595290","state":["exists","up"]},{"osd":8,"uuid":"ccbf9802-3c77-410f-ad6e-b28906ed622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6817","nonce":2898656123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6819","nonce":2898656123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6823","nonce":2898656123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2898656123},{"type":"v1","addr":"172.21.15.187:6821","nonce":2898656123}]},"public_addr":"172.21.15.187:6817/2898656123","cluster_addr":"172.21.15.187:6819/2898656123","heartbeat_back_addr":"172.21.15.187:6823/2898656123","heartbeat_front_addr":"172.21.15.187:6821/2898656123","state":["exists","up"]},{"osd":9,"uuid":"aff3c884-5283-4516-877a-c4b25cccb08b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6827","nonce":81256373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6829","nonce":81256373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6833","nonce":81256373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":81256373},{"type":"v1","addr":"172.21.15.60:6831","nonce":81256373}]},"public_addr":"172.21.15.60:6827/81256373","cluster_addr":"172.21.15.60:6829/81256373","heartbeat_back_addr":"172.21.15.60:6833/81256373","heartbeat_front_addr":"172.21.15.60:6831/81256373","state":["exists","up"]},{"osd":10,"uuid":"fd38d9d3-db87-467d-8eb8-30f7ef2d71ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6825","nonce":771892497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6827","nonce":771892497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6831","nonce":771892497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":771892497},{"type":"v1","addr":"172.21.15.123:6829","nonce":771892497}]},"public_addr":"172.21.15.123:6825/771892497","cluster_addr":"172.21.15.123:6827/771892497","heartbeat_back_addr":"172.21.15.123:6831/771892497","heartbeat_front_addr":"172.21.15.123:6829/771892497","state":["exists","up"]},{"osd":11,"uuid":"ebf88bac-fc34-49b0-b0ac-4a2ab1040524","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6825","nonce":2953073093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6827","nonce":2953073093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6831","nonce":2953073093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2953073093},{"type":"v1","addr":"172.21.15.187:6829","nonce":2953073093}]},"public_addr":"172.21.15.187:6825/2953073093","cluster_addr":"172.21.15.187:6827/2953073093","heartbeat_back_addr":"172.21.15.187:6831/2953073093","heartbeat_front_addr":"172.21.15.187:6829/2953073093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:28.730592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:27:52.751804+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:18.457252+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:28:44.026255+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:09.169863+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:34.646892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:29:59.770225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:24.279174+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:30:49.655851+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:15.097357+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:31:39.379513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:32:04.047617+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/1385204668":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/2378675823":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6800/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/920466350":"2024-09-22T07:25:32.507621+0000","172.21.15.60:6801/3227569621":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/2951813751":"2024-09-22T07:25:05.170700+0000","172.21.15.60:0/1994595675":"2024-09-22T07:25:05.170700+0000","172.21.15.60:6800/510621072":"2024-09-22T07:25:32.507621+0000","172.21.15.60:0/3389403472":"2024-09-22T07:25:05.170700+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b80b6540 msgr2=0x7f71b80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b80b6540 0x7f71b80b8a50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f71d006c8e0 tx=0x7f71c0005f90 comp rx=0 tx=0).stop 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 msgr2=0x7f71d019fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 0x7f71d019fdf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71c800b970 tx=0x7f71c800be30 comp rx=0 tx=0).stop 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 shutdown_connections 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f71b80b6540 0x7f71b80b8a50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71d010de60 0x7f71d019fdf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71d01052e0 0x7f71d019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 --2- 172.21.15.60:0/2401981929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d01048b0 0x7f71d019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 >> 172.21.15.60:0/2401981929 conn(0x7f71d0079750 msgr2=0x7f71d01008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 shutdown_connections 2024-09-21T08:00:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:17.502+0000 7f71d4d2d640 1 -- 172.21.15.60:0/2401981929 wait complete. 2024-09-21T08:00:18.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T08:00:18.414 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:18 smithi187 ceph-mon[34367]: pgmap v1108: 97 pgs: 97 active+clean; 269 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 3.9 MiB/s wr, 150 op/s 2024-09-21T08:00:18.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:18 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/2401981929' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:18.534 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:18 smithi060 ceph-mon[31244]: pgmap v1108: 97 pgs: 97 active+clean; 269 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 3.9 MiB/s wr, 150 op/s 2024-09-21T08:00:18.535 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:18 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/2401981929' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:18.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:18 smithi123 ceph-mon[34166]: pgmap v1108: 97 pgs: 97 active+clean; 269 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 3.9 MiB/s wr, 150 op/s 2024-09-21T08:00:18.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:18 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/2401981929' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T08:00:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.930+0000 7f2dd11c7640 1 -- 172.21.15.60:0/1343126507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc108d00 msgr2=0x7f2dcc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.930+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/1343126507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc108d00 0x7f2dcc10f530 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009ca0 tx=0x7f2dc402a8c0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 -- 172.21.15.60:0/1343126507 shutdown_connections 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/1343126507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc108d00 0x7f2dcc10f530 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/1343126507 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/1343126507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dcc102a70 0x7f2dcc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 -- 172.21.15.60:0/1343126507 >> 172.21.15.60:0/1343126507 conn(0x7f2dcc079710 msgr2=0x7f2dcc079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 -- 172.21.15.60:0/1343126507 shutdown_connections 2024-09-21T08:00:18.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 -- 172.21.15.60:0/1343126507 wait complete. 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.931+0000 7f2dd11c7640 1 Processor -- start 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 -- start start 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc102a70 0x7f2dcc19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dcc108d00 0x7f2dcc19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc1129c0 con 0x7f2dcc1083b0 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc112840 con 0x7f2dcc102a70 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dd11c7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f2dcc112b40 con 0x7f2dcc108d00 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41434/0 (socket says 172.21.15.60:41434) 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dc259c640 1 -- 172.21.15.60:0/3728771900 learned_addr learned my addr 172.21.15.60:0/3728771900 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dcad9d640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc102a70 0x7f2dcc19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.932+0000 7f2dcb59e640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dcc108d00 0x7f2dcc19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc259c640 1 -- 172.21.15.60:0/3728771900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dcc108d00 msgr2=0x7f2dcc19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc259c640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dcc108d00 0x7f2dcc19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc259c640 1 -- 172.21.15.60:0/3728771900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc102a70 msgr2=0x7f2dcc19b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc259c640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc102a70 0x7f2dcc19b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc259c640 1 -- 172.21.15.60:0/3728771900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc1a6590 con 0x7f2dcc1083b0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc259c640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc19b8d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c8c0 tx=0x7f2db400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4007bb0 con 0x7f2dcc1083b0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc1a6880 con 0x7f2dcc1083b0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db4007d50 con 0x7f2dcc1083b0 2024-09-21T08:00:18.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40187c0 con 0x7f2dcc1083b0 2024-09-21T08:00:18.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.933+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dcc1a6e10 con 0x7f2dcc1083b0 2024-09-21T08:00:18.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.934+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dcc103cf0 con 0x7f2dcc1083b0 2024-09-21T08:00:18.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.936+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f2db400fa20 con 0x7f2dcc1083b0 2024-09-21T08:00:18.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.937+0000 7f2dc8d99640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2db80b6540 0x7f2db80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:18.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.937+0000 7f2dcad9d640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2db80b6540 0x7f2db80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:18.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.937+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8182+0+0 (secure 0 0 0) 0x7f2db40e74a0 con 0x7f2dcc1083b0 2024-09-21T08:00:18.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.938+0000 7f2dcad9d640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2db80b6540 0x7f2db80b8a50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc06c6e0 tx=0x7f2dbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:18.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:18.940+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2db4014030 con 0x7f2dcc1083b0 2024-09-21T08:00:19.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.169+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2dcc102e80 con 0x7f2dcc1083b0 2024-09-21T08:00:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.172+0000 7f2dc8d99640 1 -- 172.21.15.60:0/3728771900 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7f2dcc102e80 con 0x7f2dcc1083b0 2024-09-21T08:00:19.173 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T08:00:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2db80b6540 msgr2=0x7f2db80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2db80b6540 0x7f2db80b8a50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc06c6e0 tx=0x7f2dbc00b390 comp rx=0 tx=0).stop 2024-09-21T08:00:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 msgr2=0x7f2dcc19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc19b8d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c8c0 tx=0x7f2db400cd80 comp rx=0 tx=0).stop 2024-09-21T08:00:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 shutdown_connections 2024-09-21T08:00:19.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f2db80b6540 0x7f2db80b8a50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dcc108d00 0x7f2dcc19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2dcc1083b0 0x7f2dcc19b8d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 --2- 172.21.15.60:0/3728771900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dcc102a70 0x7f2dcc19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.174+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 >> 172.21.15.60:0/3728771900 conn(0x7f2dcc079710 msgr2=0x7f2dcc104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.175+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 shutdown_connections 2024-09-21T08:00:19.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:19.175+0000 7f2dd11c7640 1 -- 172.21.15.60:0/3728771900 wait complete. 2024-09-21T08:00:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3728771900' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:00:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mon[34367]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:00:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mon[34367]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3728771900' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:00:19.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mon[34367]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T08:00:19.521 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mon[34367]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T08:00:19.521 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c[62718]: ignoring --setuser ceph since I am not root 2024-09-21T08:00:19.521 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c[62718]: ignoring --setgroup ceph since I am not root 2024-09-21T08:00:19.521 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c[62718]: starting mds.c at 2024-09-21T08:00:19.522 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f[62448]: ignoring --setuser ceph since I am not root 2024-09-21T08:00:19.522 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f[62448]: ignoring --setgroup ceph since I am not root 2024-09-21T08:00:19.522 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mds[62452]: -- 172.21.15.187:0/2615133554 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f4e40b5860 con 0x55f4e825da80 2024-09-21T08:00:19.522 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f[62448]: starting mds.f at 2024-09-21T08:00:19.522 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i[62990]: ignoring --setuser ceph since I am not root 2024-09-21T08:00:19.522 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i[62990]: ignoring --setgroup ceph since I am not root 2024-09-21T08:00:19.523 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-mds[62994]: -- 172.21.15.187:0/1981637174 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea3b111860 con 0x55ea3f2b9180 2024-09-21T08:00:19.523 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:00:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i[62990]: starting mds.i at 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a[31240]: 2024-09-21T08:00:19.170+0000 7fc1b14a6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3728771900' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-mon[31244]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-mon[31244]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3728771900' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-mon[31244]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T08:00:19.552 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:19 smithi060 ceph-mon[31244]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T08:00:19.600 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: ignoring --setuser ceph since I am not root 2024-09-21T08:00:19.600 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: ignoring --setgroup ceph since I am not root 2024-09-21T08:00:19.600 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mds[63001]: -- 172.21.15.123:0/1903328121 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccd5431860 con 0x55ccd95d9600 2024-09-21T08:00:19.600 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: starting mds.b at 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h[62729]: ignoring --setuser ceph since I am not root 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h[62729]: ignoring --setgroup ceph since I am not root 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mds[62733]: -- 172.21.15.123:0/3947799424 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56251439d860 con 0x562518545180 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h[62729]: starting mds.h at 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3728771900' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mon[34166]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T08:00:19.601 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mon[34166]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3728771900' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mon[34166]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mon[34166]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e[62459]: ignoring --setuser ceph since I am not root 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e[62459]: ignoring --setgroup ceph since I am not root 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-mds[62463]: -- 172.21.15.123:0/977975369 <== mon.2 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d2649bd860 con 0x55d268b65a80 2024-09-21T08:00:19.602 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:00:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e[62459]: starting mds.e at 2024-09-21T08:00:19.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T08:00:20.153 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:20.497 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:20 smithi060 ceph-mon[31244]: pgmap v1109: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.3 MiB/s wr, 133 op/s 2024-09-21T08:00:20.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:20 smithi187 ceph-mon[34367]: pgmap v1109: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.3 MiB/s wr, 133 op/s 2024-09-21T08:00:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 -- 172.21.15.60:0/3929519174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70941020e0 msgr2=0x7f70941024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 --2- 172.21.15.60:0/3929519174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70941020e0 0x7f70941024f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7084009900 tx=0x7f708402a410 comp rx=0 tx=0).stop 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 -- 172.21.15.60:0/3929519174 shutdown_connections 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 --2- 172.21.15.60:0/3929519174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7094106c20 0x7f7094110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 --2- 172.21.15.60:0/3929519174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70941062d0 0x7f70941066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 --2- 172.21.15.60:0/3929519174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70941020e0 0x7f70941024f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 -- 172.21.15.60:0/3929519174 >> 172.21.15.60:0/3929519174 conn(0x7f7094079e40 msgr2=0x7f709407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 -- 172.21.15.60:0/3929519174 shutdown_connections 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.589+0000 7f709aa37640 1 -- 172.21.15.60:0/3929519174 wait complete. 2024-09-21T08:00:20.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 Processor -- start 2024-09-21T08:00:20.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 -- start start 2024-09-21T08:00:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70941020e0 0x7f7094103080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70941062d0 0x7f70941035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 0x7f7094103b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7094113ac0 con 0x7f7094106c20 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7094113940 con 0x7f70941020e0 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f709aa37640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7f7094113c40 con 0x7f70941062d0 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.590+0000 7f7098fd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 0x7f7094103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f70937fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70941062d0 0x7f70941035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 0x7f7094103b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41450/0 (socket says 172.21.15.60:41450) 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 -- 172.21.15.60:0/590589944 learned_addr learned my addr 172.21.15.60:0/590589944 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7093fff640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70941020e0 0x7f7094103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 -- 172.21.15.60:0/590589944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70941062d0 msgr2=0x7f70941035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70941062d0 0x7f70941035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 -- 172.21.15.60:0/590589944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70941020e0 msgr2=0x7f7094103080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70941020e0 0x7f7094103080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 -- 172.21.15.60:0/590589944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70941a8730 con 0x7f7094106c20 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7093fff640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70941020e0 0x7f7094103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f7098fd4640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 0x7f7094103b00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f708c00eb10 tx=0x7f708c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c004b20 con 0x7f7094106c20 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70941a8a20 con 0x7f7094106c20 2024-09-21T08:00:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f708c004cc0 con 0x7f7094106c20 2024-09-21T08:00:20.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c010670 con 0x7f7094106c20 2024-09-21T08:00:20.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.591+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a8f10 con 0x7f7094106c20 2024-09-21T08:00:20.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.592+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70941024f0 con 0x7f7094106c20 2024-09-21T08:00:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.594+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f708c005000 con 0x7f7094106c20 2024-09-21T08:00:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.595+0000 7f70917fa640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f707c0b6510 0x7f707c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.595+0000 7f7093fff640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f707c0b6510 0x7f707c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.595+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8440+0+0 (secure 0 0 0) 0x7f708c0e7ba0 con 0x7f7094106c20 2024-09-21T08:00:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.596+0000 7f7093fff640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f707c0b6510 0x7f707c0b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7084000c00 tx=0x7f7084009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:20.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:20 smithi123 ceph-mon[34166]: pgmap v1109: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.3 MiB/s wr, 133 op/s 2024-09-21T08:00:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.598+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f708c056710 con 0x7f7094106c20 2024-09-21T08:00:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:20.825+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f709402e640 con 0x7f7094106c20 2024-09-21T08:00:21.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.201+0000 7f70917fa640 1 -- 172.21.15.60:0/590589944 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f708c0ae300 con 0x7f7094106c20 2024-09-21T08:00:21.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.203+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f707c0b6510 msgr2=0x7f707c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.203+0000 7f709aa37640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f707c0b6510 0x7f707c0b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7084000c00 tx=0x7f7084009680 comp rx=0 tx=0).stop 2024-09-21T08:00:21.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.203+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 msgr2=0x7f7094103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:21.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.203+0000 7f709aa37640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 0x7f7094103b00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f708c00eb10 tx=0x7f708c00c2d0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 shutdown_connections 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7f707c0b6510 0x7f707c0b8a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7094106c20 0x7f7094103b00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70941062d0 0x7f70941035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 --2- 172.21.15.60:0/590589944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70941020e0 0x7f7094103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 >> 172.21.15.60:0/590589944 conn(0x7f7094079e40 msgr2=0x7f70941080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 shutdown_connections 2024-09-21T08:00:21.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:21.204+0000 7f709aa37640 1 -- 172.21.15.60:0/590589944 wait complete. 2024-09-21T08:00:21.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6834/1766765900,v1:172.21.15.187:6835/1766765900] up:boot 2024-09-21T08:00:21.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6836/2832815462,v1:172.21.15.187:6838/2832815462] up:boot 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.187:6837/3721866156,v1:172.21.15.187:6839/3721866156] up:boot 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6834/2225751251,v1:172.21.15.123:6835/2225751251] up:boot 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6836/1191894167,v1:172.21.15.123:6838/1191894167] up:boot 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: mds.? [v2:172.21.15.123:6837/1429413919,v1:172.21.15.123:6839/1429413919] up:boot 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T08:00:21.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:21 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/590589944' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:00:21.559 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6834/1766765900,v1:172.21.15.187:6835/1766765900] up:boot 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6836/2832815462,v1:172.21.15.187:6838/2832815462] up:boot 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.187:6837/3721866156,v1:172.21.15.187:6839/3721866156] up:boot 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6834/2225751251,v1:172.21.15.123:6835/2225751251] up:boot 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6836/1191894167,v1:172.21.15.123:6838/1191894167] up:boot 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: mds.? [v2:172.21.15.123:6837/1429413919,v1:172.21.15.123:6839/1429413919] up:boot 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T08:00:21.560 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:21 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/590589944' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6834/1766765900,v1:172.21.15.187:6835/1766765900] up:boot 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6836/2832815462,v1:172.21.15.187:6838/2832815462] up:boot 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.187:6837/3721866156,v1:172.21.15.187:6839/3721866156] up:boot 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6834/2225751251,v1:172.21.15.123:6835/2225751251] up:boot 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6836/1191894167,v1:172.21.15.123:6838/1191894167] up:boot 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: mds.? [v2:172.21.15.123:6837/1429413919,v1:172.21.15.123:6839/1429413919] up:boot 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T08:00:21.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T08:00:21.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T08:00:21.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T08:00:21.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T08:00:21.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T08:00:21.600 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:21 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/590589944' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T08:00:22.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T08:00:22.339 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:22 smithi060 ceph-mon[31244]: pgmap v1111: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 2.9 MiB/s wr, 119 op/s 2024-09-21T08:00:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:22 smithi060 ceph-mon[31244]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:00:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:22 smithi060 ceph-mon[31244]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:00:22.371 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:22 smithi060 ceph-mon[31244]: Cluster is now healthy 2024-09-21T08:00:22.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:22 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/590589944' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:00:22.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:22 smithi060 ceph-mon[31244]: fsmap 12 up:standby 2024-09-21T08:00:22.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:22 smithi187 ceph-mon[34367]: pgmap v1111: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 2.9 MiB/s wr, 119 op/s 2024-09-21T08:00:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:22 smithi187 ceph-mon[34367]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:00:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:22 smithi187 ceph-mon[34367]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:00:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:22 smithi187 ceph-mon[34367]: Cluster is now healthy 2024-09-21T08:00:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:22 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/590589944' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:00:22.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:22 smithi187 ceph-mon[34367]: fsmap 12 up:standby 2024-09-21T08:00:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:22 smithi123 ceph-mon[34166]: pgmap v1111: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 2.9 MiB/s wr, 119 op/s 2024-09-21T08:00:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:22 smithi123 ceph-mon[34166]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T08:00:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:22 smithi123 ceph-mon[34166]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T08:00:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:22 smithi123 ceph-mon[34166]: Cluster is now healthy 2024-09-21T08:00:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:22 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/590589944' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T08:00:22.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:22 smithi123 ceph-mon[34166]: fsmap 12 up:standby 2024-09-21T08:00:22.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 -- 172.21.15.60:0/1461162038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 msgr2=0x7ff6f4106700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:22.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 --2- 172.21.15.60:0/1461162038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4106700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8009900 tx=0x7ff6e802a410 comp rx=0 tx=0).stop 2024-09-21T08:00:22.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 -- 172.21.15.60:0/1461162038 shutdown_connections 2024-09-21T08:00:22.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 --2- 172.21.15.60:0/1461162038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f4106c40 0x7ff6f41106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:22.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 --2- 172.21.15.60:0/1461162038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4106700 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:22.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 --2- 172.21.15.60:0/1461162038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6f41020a0 0x7ff6f41024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:22.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 -- 172.21.15.60:0/1461162038 >> 172.21.15.60:0/1461162038 conn(0x7ff6f4079f90 msgr2=0x7ff6f407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:22.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 -- 172.21.15.60:0/1461162038 shutdown_connections 2024-09-21T08:00:22.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.792+0000 7ff6f890c640 1 -- 172.21.15.60:0/1461162038 wait complete. 2024-09-21T08:00:22.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 Processor -- start 2024-09-21T08:00:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 -- start start 2024-09-21T08:00:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f41020a0 0x7ff6f4103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6f4106c40 0x7ff6f4103ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113af0 con 0x7ff6f41062f0 2024-09-21T08:00:22.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113970 con 0x7ff6f41020a0 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f890c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113c70 con 0x7ff6f4106c40 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4103580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41476/0 (socket says 172.21.15.60:41476) 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f1d9b640 1 -- 172.21.15.60:0/4227341866 learned_addr learned my addr 172.21.15.60:0/4227341866 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f2d9d640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6f4106c40 0x7ff6f4103ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.793+0000 7ff6f259c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f41020a0 0x7ff6f4103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f1d9b640 1 -- 172.21.15.60:0/4227341866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6f4106c40 msgr2=0x7ff6f4103ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:22.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f1d9b640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6f4106c40 0x7ff6f4103ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f1d9b640 1 -- 172.21.15.60:0/4227341866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f41020a0 msgr2=0x7ff6f4103040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f1d9b640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f41020a0 0x7ff6f4103040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f1d9b640 1 -- 172.21.15.60:0/4227341866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f41a8820 con 0x7ff6f41062f0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f259c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f41020a0 0x7ff6f4103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f1d9b640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4103580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8005940 tx=0x7ff6e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e803f030 con 0x7ff6f41062f0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6e8003cb0 con 0x7ff6f41062f0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e8035070 con 0x7ff6f41062f0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f41a8ab0 con 0x7ff6f41062f0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.794+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f41a8f90 con 0x7ff6f41062f0 2024-09-21T08:00:22.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.795+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f41024b0 con 0x7ff6f41062f0 2024-09-21T08:00:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.797+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7ff6e8042030 con 0x7ff6f41062f0 2024-09-21T08:00:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.797+0000 7ff6e37fe640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff6dc0b6510 0x7ff6dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.798+0000 7ff6f259c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff6dc0b6510 0x7ff6dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.798+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8440+0+0 (secure 0 0 0) 0x7ff6e8107b60 con 0x7ff6f41062f0 2024-09-21T08:00:22.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.798+0000 7ff6f259c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff6dc0b6510 0x7ff6dc0b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4005d00 tx=0x7ff6e4005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:22.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.801+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6e80ce320 con 0x7ff6f41062f0 2024-09-21T08:00:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:22.990+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff6f402e640 con 0x7ff6f41062f0 2024-09-21T08:00:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.208+0000 7ff6e37fe640 1 -- 172.21.15.60:0/4227341866 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) ==== 181+0+0 (secure 0 0 0) 0x7ff6e80d2700 con 0x7ff6f41062f0 2024-09-21T08:00:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-21T08:00:23.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.211+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff6dc0b6510 msgr2=0x7ff6dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.211+0000 7ff6f890c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff6dc0b6510 0x7ff6dc0b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4005d00 tx=0x7ff6e4005c70 comp rx=0 tx=0).stop 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.211+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 msgr2=0x7ff6f4103580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.211+0000 7ff6f890c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4103580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8005940 tx=0x7ff6e80042f0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 shutdown_connections 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7ff6dc0b6510 0x7ff6dc0b8a20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6f4106c40 0x7ff6f4103ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f41062f0 0x7ff6f4103580 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 --2- 172.21.15.60:0/4227341866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6f41020a0 0x7ff6f4103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 >> 172.21.15.60:0/4227341866 conn(0x7ff6f4079f90 msgr2=0x7ff6f41055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 shutdown_connections 2024-09-21T08:00:23.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:23.212+0000 7ff6f890c640 1 -- 172.21.15.60:0/4227341866 wait complete. 2024-09-21T08:00:23.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:23 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4227341866' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:00:23.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:23 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4227341866' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:00:23.598 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:23 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4227341866' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:00:23.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 679a927c-77ea-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T08:00:24.138 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T08:00:24.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:24 smithi060 ceph-mon[31244]: pgmap v1112: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-21T08:00:24.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:24 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/4227341866' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:00:24.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:24 smithi060 ceph-mon[31244]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T08:00:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:24 smithi187 ceph-mon[34367]: pgmap v1112: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-21T08:00:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:24 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/4227341866' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:00:24.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:24 smithi187 ceph-mon[34367]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T08:00:24.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 -- 172.21.15.60:0/2461122992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144109df0 msgr2=0x7fb144110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:24.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 --2- 172.21.15.60:0/2461122992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144109df0 0x7fb144110620 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009900 tx=0x7fb13c02a410 comp rx=0 tx=0).stop 2024-09-21T08:00:24.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 -- 172.21.15.60:0/2461122992 shutdown_connections 2024-09-21T08:00:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 --2- 172.21.15.60:0/2461122992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144109df0 0x7fb144110620 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 --2- 172.21.15.60:0/2461122992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1441094a0 0x7fb1441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 --2- 172.21.15.60:0/2461122992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb144103b60 0x7fb144103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.579+0000 7fb14c376640 1 -- 172.21.15.60:0/2461122992 >> 172.21.15.60:0/2461122992 conn(0x7fb14407b850 msgr2=0x7fb14407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:24.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.580+0000 7fb14c376640 1 -- 172.21.15.60:0/2461122992 shutdown_connections 2024-09-21T08:00:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.580+0000 7fb14c376640 1 -- 172.21.15.60:0/2461122992 wait complete. 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.580+0000 7fb14c376640 1 Processor -- start 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.580+0000 7fb14c376640 1 -- start start 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14c376640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 0x7fb144075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14c376640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1441094a0 0x7fb144075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14c376640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb144109df0 0x7fb144076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14c376640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb144113ab0 con 0x7fb144103b60 2024-09-21T08:00:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14c376640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb144113930 con 0x7fb144109df0 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14c376640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 -- 0x7fb144113c30 con 0x7fb1441094a0 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 0x7fb144075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 0x7fb144075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41482/0 (socket says 172.21.15.60:41482) 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 -- 172.21.15.60:0/3909608958 learned_addr learned my addr 172.21.15.60:0/3909608958 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb149911640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1441094a0 0x7fb144075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a913640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb144109df0 0x7fb144076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 -- 172.21.15.60:0/3909608958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1441094a0 msgr2=0x7fb144075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1441094a0 0x7fb144075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 -- 172.21.15.60:0/3909608958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb144109df0 msgr2=0x7fb144076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb144109df0 0x7fb144076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 -- 172.21.15.60:0/3909608958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1441a86c0 con 0x7fb144103b60 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb14a112640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 0x7fb144075710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb14000ebc0 tx=0x7fb14000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.581+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140010630 con 0x7fb144103b60 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.582+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb140010c80 con 0x7fb144103b60 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.582+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1441a89b0 con 0x7fb144103b60 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.582+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140018b60 con 0x7fb144103b60 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.582+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1441a8f40 con 0x7fb144103b60 2024-09-21T08:00:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.583+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb144103f70 con 0x7fb144103b60 2024-09-21T08:00:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.584+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb140018d00 con 0x7fb144103b60 2024-09-21T08:00:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.585+0000 7fb13b7fe640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb1300b6590 0x7fb1300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T08:00:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.585+0000 7fb149911640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb1300b6590 0x7fb1300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T08:00:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.585+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7886+0+0 (secure 0 0 0) 0x7fb1400e7cc0 con 0x7fb144103b60 2024-09-21T08:00:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.586+0000 7fb149911640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb1300b6590 0x7fb1300b8aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb144109170 tx=0x7fb13400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T08:00:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.588+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1400ae660 con 0x7fb144103b60 2024-09-21T08:00:25.163 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:24 smithi123 ceph-mon[34166]: pgmap v1112: 97 pgs: 97 active+clean; 261 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.2 MiB/s wr, 67 op/s 2024-09-21T08:00:25.163 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:24 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/4227341866' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:00:25.163 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:24 smithi123 ceph-mon[34166]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T08:00:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:24.781+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb14402e640 con 0x7fb144103b60 2024-09-21T08:00:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.216+0000 7fb13b7fe640 1 -- 172.21.15.60:0/3909608958 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) ==== 169+0+0 (secure 0 0 0) 0x7fb1400b2a40 con 0x7fb144103b60 2024-09-21T08:00:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb1300b6590 msgr2=0x7fb1300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb1300b6590 0x7fb1300b8aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb144109170 tx=0x7fb13400b390 comp rx=0 tx=0).stop 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 msgr2=0x7fb144075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 0x7fb144075710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb14000ebc0 tx=0x7fb14000c6a0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 shutdown_connections 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:6800/2850568081,v1:172.21.15.60:6801/2850568081] conn(0x7fb1300b6590 0x7fb1300b8aa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb144109df0 0x7fb144076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1441094a0 0x7fb144075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 --2- 172.21.15.60:0/3909608958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb144103b60 0x7fb144075710 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T08:00:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.221+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 >> 172.21.15.60:0/3909608958 conn(0x7fb14407b850 msgr2=0x7fb144107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T08:00:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.222+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 shutdown_connections 2024-09-21T08:00:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T08:00:25.222+0000 7fb14c376640 1 -- 172.21.15.60:0/3909608958 wait complete. 2024-09-21T08:00:25.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:25 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3909608958' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:00:25.599 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:25 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3909608958' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:00:25.621 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:25 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3909608958' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T08:00:26.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:00:26.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:00:26.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:00:26.135 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T08:00:26.135 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:00:26.152 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:00:26.168 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T08:00:26.190 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T08:00:26.190 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T08:00:26.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a 2024-09-21T08:00:26.348 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: pgmap v1114: 65 pgs: 65 active+clean; 577 KiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:00:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: from='client.? 172.21.15.60:0/3909608958' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:00:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T08:00:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:26.349 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:26 smithi123 ceph-mon[34166]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: pgmap v1114: 65 pgs: 65 active+clean; 577 KiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: from='client.? 172.21.15.60:0/3909608958' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-mon[31244]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T08:00:26.372 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 systemd[1]: Stopping Ceph mon.a for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: pgmap v1114: 65 pgs: 65 active+clean; 577 KiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T08:00:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: from='client.? 172.21.15.60:0/3909608958' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T08:00:26.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T08:00:26.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T08:00:26.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T08:00:26.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T08:00:26.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:26 smithi187 ceph-mon[34367]: from='mgr.14150 172.21.15.60:0/1919043949' entity='mgr.x' 2024-09-21T08:00:26.791 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a[31240]: 2024-09-21T08:00:26.462+0000 7fc1b6cb1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:26.791 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a[31240]: 2024-09-21T08:00:26.463+0000 7fc1b6cb1640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T08:00:26.791 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 podman[88721]: 2024-09-21 08:00:26.505135815 +0000 UTC m=+0.124389190 container died bd8556fbf0995589bf63db708a19e7a4144093d0bfb6323fa1c76561ac9e3a51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T08:00:27.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 podman[88721]: 2024-09-21 08:00:26.871632327 +0000 UTC m=+0.490885700 container cleanup bd8556fbf0995589bf63db708a19e7a4144093d0bfb6323fa1c76561ac9e3a51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:00:27.122 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 21 08:00:26 smithi060 bash[88721]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-a 2024-09-21T08:00:27.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T08:00:27.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:27.370 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T08:00:27.370 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T08:00:27.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.b 2024-09-21T08:00:27.837 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:27 smithi123 systemd[1]: Stopping Ceph mon.b for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:28.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-b[34162]: 2024-09-21T08:00:27.835+0000 7f3e55163640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:28.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-b[34162]: 2024-09-21T08:00:27.835+0000 7f3e55163640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:00:28.099 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:27 smithi123 podman[69254]: 2024-09-21 08:00:27.989149362 +0000 UTC m=+0.339469636 container died 368ee80839d3e756d5e8e01440308c463738238b86df2eeee836dc671637dfed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-b, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T08:00:28.679 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:28 smithi123 podman[69254]: 2024-09-21 08:00:28.402353942 +0000 UTC m=+0.752674216 container cleanup 368ee80839d3e756d5e8e01440308c463738238b86df2eeee836dc671637dfed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T08:00:28.679 INFO:journalctl@ceph.mon.b.smithi123.stdout:Sep 21 08:00:28 smithi123 bash[69254]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-b 2024-09-21T08:00:28.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T08:00:28.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:28.870 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T08:00:28.870 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T08:00:28.870 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.c 2024-09-21T08:00:29.193 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:28 smithi187 systemd[1]: Stopping Ceph mon.c for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-c[34363]: 2024-09-21T08:00:29.191+0000 7f43121c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-c[34363]: 2024-09-21T08:00:29.191+0000 7f43121c3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T08:00:29.520 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:29 smithi187 podman[68712]: 2024-09-21 08:00:29.416149551 +0000 UTC m=+0.343557935 container died a171f0dd1e34364b480c595a3e4090609433054455a449b94d6228c63e96c5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T08:00:30.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:29 smithi187 podman[68712]: 2024-09-21 08:00:29.791466759 +0000 UTC m=+0.718875141 container cleanup a171f0dd1e34364b480c595a3e4090609433054455a449b94d6228c63e96c5ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:00:30.019 INFO:journalctl@ceph.mon.c.smithi187.stdout:Sep 21 08:00:29 smithi187 bash[68712]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mon-c 2024-09-21T08:00:30.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T08:00:30.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:30.262 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T08:00:30.262 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T08:00:30.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x 2024-09-21T08:00:30.579 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 08:00:30 smithi060 systemd[1]: Stopping Ceph mgr.x for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:30.871 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 08:00:30 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x[31473]: 2024-09-21T08:00:30.576+0000 7fa2d98ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:30.872 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 08:00:30 smithi060 podman[88845]: 2024-09-21 08:00:30.608191848 +0000 UTC m=+0.136679941 container died cd65c878540b8b5735b02563bbcc0778506181304e3291383cd961873e1a7e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T08:00:31.221 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 08:00:30 smithi060 podman[88845]: 2024-09-21 08:00:30.993756012 +0000 UTC m=+0.522244095 container cleanup cd65c878540b8b5735b02563bbcc0778506181304e3291383cd961873e1a7e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T08:00:31.221 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 21 08:00:30 smithi060 bash[88845]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-x 2024-09-21T08:00:31.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T08:00:31.384 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:31.384 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T08:00:31.384 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T08:00:31.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.y 2024-09-21T08:00:31.798 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 08:00:31 smithi123 systemd[1]: Stopping Ceph mgr.y for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:32.059 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 08:00:31 smithi123 podman[69392]: 2024-09-21 08:00:31.796770849 +0000 UTC m=+0.224781426 container died 0194e1fe0d62bee5764f74f4c9cfd0a1c55182ff8cbdc0e9fb1cbf237980be60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:00:32.348 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 08:00:32 smithi123 podman[69392]: 2024-09-21 08:00:32.148967663 +0000 UTC m=+0.576978238 container cleanup 0194e1fe0d62bee5764f74f4c9cfd0a1c55182ff8cbdc0e9fb1cbf237980be60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T08:00:32.348 INFO:journalctl@ceph.mgr.y.smithi123.stdout:Sep 21 08:00:32 smithi123 bash[69392]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-y 2024-09-21T08:00:32.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T08:00:32.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:32.623 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T08:00:32.623 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T08:00:32.623 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.z 2024-09-21T08:00:32.942 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 08:00:32 smithi187 systemd[1]: Stopping Ceph mgr.z for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:33.231 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 08:00:32 smithi187 podman[68838]: 2024-09-21 08:00:32.941805118 +0000 UTC m=+0.127167297 container died f0a4d785a51c22d4e07f69cc193467ad7530aca29e6efbfe6989e14569ddba05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-z, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:00:33.519 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 08:00:33 smithi187 podman[68838]: 2024-09-21 08:00:33.337657996 +0000 UTC m=+0.523020174 container cleanup f0a4d785a51c22d4e07f69cc193467ad7530aca29e6efbfe6989e14569ddba05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T08:00:33.519 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Sep 21 08:00:33 smithi187 bash[68838]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mgr-z 2024-09-21T08:00:33.765 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T08:00:33.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:33.799 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T08:00:33.799 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T08:00:33.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.0 2024-09-21T08:00:34.099 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:33 smithi060 systemd[1]: Stopping Ceph osd.0 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:34.371 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0[46890]: 2024-09-21T08:00:34.098+0000 7f7722667640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:34.372 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0[46890]: 2024-09-21T08:00:34.098+0000 7f7722667640 -1 osd.0 79 *** Got signal Terminated *** 2024-09-21T08:00:34.372 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0[46890]: 2024-09-21T08:00:34.098+0000 7f7722667640 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:00:39.825 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:39 smithi060 podman[88966]: 2024-09-21 08:00:39.510559175 +0000 UTC m=+5.511772701 container died 6510ffa92d9f4e1b7a42359797cca194ef0e709e55d9c020477a320c1dcc940d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:00:40.121 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:39 smithi060 podman[88966]: 2024-09-21 08:00:39.923632363 +0000 UTC m=+5.924845879 container cleanup 6510ffa92d9f4e1b7a42359797cca194ef0e709e55d9c020477a320c1dcc940d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T08:00:40.121 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:39 smithi060 bash[88966]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0 2024-09-21T08:00:40.614 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:40 smithi060 podman[88981]: 2024-09-21 08:00:40.152638523 +0000 UTC m=+0.635159241 container remove 6510ffa92d9f4e1b7a42359797cca194ef0e709e55d9c020477a320c1dcc940d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T08:00:40.872 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:40 smithi060 podman[89066]: 2024-09-21 08:00:40.515883802 +0000 UTC m=+0.016593188 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:00:40.872 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:40 smithi060 podman[89066]: 2024-09-21 08:00:40.617555988 +0000 UTC m=+0.118265367 container create 2fa94f2cd236eefef1edb1819a89018ac32708852bfecbcbbd9836f5ad4da5a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:00:41.369 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:40 smithi060 podman[89066]: 2024-09-21 08:00:40.878438295 +0000 UTC m=+0.379147679 container init 2fa94f2cd236eefef1edb1819a89018ac32708852bfecbcbbd9836f5ad4da5a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:00:41.370 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:40 smithi060 podman[89066]: 2024-09-21 08:00:40.882173075 +0000 UTC m=+0.382882454 container start 2fa94f2cd236eefef1edb1819a89018ac32708852bfecbcbbd9836f5ad4da5a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:00:41.370 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:40 smithi060 podman[89066]: 2024-09-21 08:00:40.961931857 +0000 UTC m=+0.462641256 container attach 2fa94f2cd236eefef1edb1819a89018ac32708852bfecbcbbd9836f5ad4da5a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T08:00:41.370 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 21 08:00:41 smithi060 podman[89066]: 2024-09-21 08:00:41.076331219 +0000 UTC m=+0.577040610 container died 2fa94f2cd236eefef1edb1819a89018ac32708852bfecbcbbd9836f5ad4da5a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:00:41.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T08:00:41.774 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:41.774 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T08:00:41.774 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T08:00:41.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.1 2024-09-21T08:00:42.096 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:41 smithi123 systemd[1]: Stopping Ceph osd.1 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:42.349 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1[38079]: 2024-09-21T08:00:42.094+0000 7fc7bf360640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:42.350 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1[38079]: 2024-09-21T08:00:42.094+0000 7fc7bf360640 -1 osd.1 79 *** Got signal Terminated *** 2024-09-21T08:00:42.350 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1[38079]: 2024-09-21T08:00:42.094+0000 7fc7bf360640 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:00:47.912 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:47 smithi123 podman[69516]: 2024-09-21 08:00:47.633680492 +0000 UTC m=+5.668955640 container died f1868d60837a34f3991f6f07cc4fcb3d556cbf4fa61d819a765c4b6d7594a679 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T08:00:48.205 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:47 smithi123 podman[69516]: 2024-09-21 08:00:47.911422527 +0000 UTC m=+5.946697664 container cleanup f1868d60837a34f3991f6f07cc4fcb3d556cbf4fa61d819a765c4b6d7594a679 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T08:00:48.205 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:47 smithi123 bash[69516]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1 2024-09-21T08:00:48.531 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:48 smithi123 podman[69532]: 2024-09-21 08:00:48.204602042 +0000 UTC m=+0.569796688 container remove f1868d60837a34f3991f6f07cc4fcb3d556cbf4fa61d819a765c4b6d7594a679 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T08:00:48.792 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:48 smithi123 podman[69620]: 2024-09-21 08:00:48.530431914 +0000 UTC m=+0.095497525 container create 574a123776107ced4f730a077298ee34c9a26e191e10a9b2eba4530c72f34c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T08:00:48.793 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:48 smithi123 podman[69620]: 2024-09-21 08:00:48.45041319 +0000 UTC m=+0.015478813 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:00:49.099 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:48 smithi123 podman[69620]: 2024-09-21 08:00:48.791939769 +0000 UTC m=+0.357005394 container init 574a123776107ced4f730a077298ee34c9a26e191e10a9b2eba4530c72f34c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T08:00:49.099 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:48 smithi123 podman[69620]: 2024-09-21 08:00:48.795687422 +0000 UTC m=+0.360753034 container start 574a123776107ced4f730a077298ee34c9a26e191e10a9b2eba4530c72f34c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T08:00:49.099 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:48 smithi123 podman[69620]: 2024-09-21 08:00:48.89142679 +0000 UTC m=+0.456492401 container attach 574a123776107ced4f730a077298ee34c9a26e191e10a9b2eba4530c72f34c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T08:00:49.449 INFO:journalctl@ceph.osd.1.smithi123.stdout:Sep 21 08:00:49 smithi123 podman[69620]: 2024-09-21 08:00:49.176131251 +0000 UTC m=+0.741196866 container died 574a123776107ced4f730a077298ee34c9a26e191e10a9b2eba4530c72f34c94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T08:00:49.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T08:00:49.783 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:49.783 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T08:00:49.784 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T08:00:49.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.2 2024-09-21T08:00:50.084 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:49 smithi187 systemd[1]: Stopping Ceph osd.2 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:50.519 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2[38734]: 2024-09-21T08:00:50.082+0000 7fa5c1a76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:50.519 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2[38734]: 2024-09-21T08:00:50.082+0000 7fa5c1a76640 -1 osd.2 79 *** Got signal Terminated *** 2024-09-21T08:00:50.519 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2[38734]: 2024-09-21T08:00:50.082+0000 7fa5c1a76640 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:00:55.784 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:55 smithi187 podman[68962]: 2024-09-21 08:00:55.522540154 +0000 UTC m=+5.538414969 container died f55edc2ce18226812104720c3b485cbee96703d8ee09337fec7fffa30e573fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:00:56.143 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:55 smithi187 podman[68962]: 2024-09-21 08:00:55.899172183 +0000 UTC m=+5.915046995 container cleanup f55edc2ce18226812104720c3b485cbee96703d8ee09337fec7fffa30e573fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T08:00:56.143 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:55 smithi187 bash[68962]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2 2024-09-21T08:00:56.460 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[68978]: 2024-09-21 08:00:56.142127107 +0000 UTC m=+0.618448965 container remove f55edc2ce18226812104720c3b485cbee96703d8ee09337fec7fffa30e573fa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T08:00:56.763 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[69067]: 2024-09-21 08:00:56.362434182 +0000 UTC m=+0.015834454 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:00:56.763 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[69067]: 2024-09-21 08:00:56.466282321 +0000 UTC m=+0.119682578 container create 3fc164fbe304ef1a48077a337a574bcc18f2304630fea7a2d00bc96fcb324387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T08:00:56.763 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[69067]: 2024-09-21 08:00:56.679439847 +0000 UTC m=+0.332840113 container init 3fc164fbe304ef1a48077a337a574bcc18f2304630fea7a2d00bc96fcb324387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T08:00:56.763 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[69067]: 2024-09-21 08:00:56.683251967 +0000 UTC m=+0.336652230 container start 3fc164fbe304ef1a48077a337a574bcc18f2304630fea7a2d00bc96fcb324387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T08:00:56.763 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[69067]: 2024-09-21 08:00:56.762372746 +0000 UTC m=+0.415773011 container attach 3fc164fbe304ef1a48077a337a574bcc18f2304630fea7a2d00bc96fcb324387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T08:00:57.019 INFO:journalctl@ceph.osd.2.smithi187.stdout:Sep 21 08:00:56 smithi187 podman[69067]: 2024-09-21 08:00:56.872097445 +0000 UTC m=+0.525497710 container died 3fc164fbe304ef1a48077a337a574bcc18f2304630fea7a2d00bc96fcb324387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:00:57.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T08:00:57.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:00:57.496 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T08:00:57.496 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T08:00:57.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.3 2024-09-21T08:00:57.803 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:00:57 smithi060 systemd[1]: Stopping Ceph osd.3 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:00:58.121 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:00:57 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3[53326]: 2024-09-21T08:00:57.801+0000 7fda51f4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:00:58.121 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:00:57 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3[53326]: 2024-09-21T08:00:57.801+0000 7fda51f4d640 -1 osd.3 79 *** Got signal Terminated *** 2024-09-21T08:00:58.122 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:00:57 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3[53326]: 2024-09-21T08:00:57.801+0000 7fda51f4d640 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:00.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:00.159+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:00.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:00 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:00.593+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:01.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:01.208+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:01.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:01 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:01.600+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:02.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:02.256+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:02.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:02 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:02.128+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:02.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:02 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:02.588+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:03.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:03.232+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:03.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:03 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:03.139+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:03.670 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:03 smithi060 podman[89183]: 2024-09-21 08:01:03.397818087 +0000 UTC m=+5.696924961 container died 69c1c36015f449713640da45bc7efa350bb2d27a0639a757b411603a58795763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T08:01:03.670 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:03 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:03.594+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:04.121 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:03 smithi060 podman[89183]: 2024-09-21 08:01:03.768749185 +0000 UTC m=+6.067856056 container cleanup 69c1c36015f449713640da45bc7efa350bb2d27a0639a757b411603a58795763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:04.122 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:03 smithi060 bash[89183]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3 2024-09-21T08:01:04.217 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:03.805+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:04.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:04.216+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:04.538 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89213]: 2024-09-21 08:01:04.154876727 +0000 UTC m=+0.751747666 container remove 69c1c36015f449713640da45bc7efa350bb2d27a0639a757b411603a58795763 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T08:01:04.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:04 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:04.177+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:04.858 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89299]: 2024-09-21 08:01:04.53784885 +0000 UTC m=+0.111834471 container create 2a9e76a4dd4aceb865d0ab46866ddfca8e63192b00d27c73939efe81f01806ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T08:01:04.858 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89299]: 2024-09-21 08:01:04.442327826 +0000 UTC m=+0.016313432 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:04.858 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89299]: 2024-09-21 08:01:04.765121203 +0000 UTC m=+0.339106790 container init 2a9e76a4dd4aceb865d0ab46866ddfca8e63192b00d27c73939efe81f01806ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T08:01:04.858 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89299]: 2024-09-21 08:01:04.768503421 +0000 UTC m=+0.342489008 container start 2a9e76a4dd4aceb865d0ab46866ddfca8e63192b00d27c73939efe81f01806ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T08:01:04.859 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:04 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:04.755+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:04.859 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:04 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:04.621+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:05.122 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89299]: 2024-09-21 08:01:04.856902752 +0000 UTC m=+0.430888342 container attach 2a9e76a4dd4aceb865d0ab46866ddfca8e63192b00d27c73939efe81f01806ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T08:01:05.122 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 21 08:01:04 smithi060 podman[89299]: 2024-09-21 08:01:04.972220453 +0000 UTC m=+0.546206034 container died 2a9e76a4dd4aceb865d0ab46866ddfca8e63192b00d27c73939efe81f01806ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T08:01:05.204 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:04.851+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:05.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:05.203+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:05.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:05 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:05.217+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:05.678 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:05 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:05.629+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:05.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T08:01:05.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:05.751 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T08:01:05.751 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T08:01:05.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.4 2024-09-21T08:01:05.974 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:05 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:05.779+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:06.057 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:05 smithi123 systemd[1]: Stopping Ceph osd.4 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:06.221 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:05.806+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:06.348 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:06 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:06.246+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:06.349 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:06 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T08:01:06.055+0000 7f5c38214640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:06.349 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:06 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T08:01:06.055+0000 7f5c38214640 -1 osd.4 79 *** Got signal Terminated *** 2024-09-21T08:01:06.349 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:06 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T08:01:06.055+0000 7f5c38214640 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:06.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:06 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:06.220+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:06.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:06.599+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:06.872 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:06 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:06.765+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:07.249 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:06 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:06.830+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:07.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:07 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:07.248+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:07.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:07 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:07.268+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:07.871 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:07 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:07.796+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:07.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:07 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:07.583+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:08.175 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:07 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:07.820+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:08.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:08 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:08.294+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:08.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:08 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:08.300+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:08.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:08 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:08.300+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:08.843 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:08.556+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:09.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:08 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:08.798+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:09.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:08 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:08.841+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:09.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:09 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:09.152+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:09.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:09 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:09.273+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:09.598 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:09 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T08:01:09.127+0000 7f5c347ff640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.149756+0000 front 2024-09-21T08:00:44.149786+0000 (oldest deadline 2024-09-21T08:01:08.249882+0000) 2024-09-21T08:01:09.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:09 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:09.137+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:09.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:09 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:09.329+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:09.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:09 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:09.329+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:09.871 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:09 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:09.791+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:09.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:09 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:09.603+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:09.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:09 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:09.603+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:10.124 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:09 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:09.801+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:10.124 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:09 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:09.801+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:10.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:10 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:10.253+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:10.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:10 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:10.123+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:10.598 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:10 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4[44688]: 2024-09-21T08:01:10.145+0000 7f5c347ff640 -1 osd.4 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.149756+0000 front 2024-09-21T08:00:44.149786+0000 (oldest deadline 2024-09-21T08:01:08.249882+0000) 2024-09-21T08:01:10.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:10 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:10.149+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:10.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:10 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:10.302+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:10.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:10 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:10.302+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:10.872 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:10 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:10.742+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:10.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:10 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:10.562+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:10.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:10 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:10.562+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:11.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:10 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:10.759+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:11.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:10 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:10.759+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:11.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:11 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:11.166+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:11.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:11 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:11.276+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:11.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:11 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:11.276+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:11.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:11 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:11.118+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:11.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:11 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:11.270+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:11.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:11 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:11.270+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:11.871 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:11.780+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:11.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:11.532+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:11.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:11 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:11.532+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:11.907 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:11 smithi123 podman[69754]: 2024-09-21 08:01:11.640818092 +0000 UTC m=+5.689127808 container died 9dad3528309c83fd094035e50a143009c7faa89269da8d2d32c63327d6a357c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:01:12.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:11 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:11.719+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:12.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:11 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:11.719+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:12.227 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:12 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:12.104+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:12.228 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:11 smithi123 podman[69754]: 2024-09-21 08:01:11.997347457 +0000 UTC m=+6.045657169 container cleanup 9dad3528309c83fd094035e50a143009c7faa89269da8d2d32c63327d6a357c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T08:01:12.228 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:11 smithi123 bash[69754]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4 2024-09-21T08:01:12.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:12 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:12.203+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:12.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:12 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:12.279+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:12.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:12 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:12.279+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:12.598 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:12 smithi123 podman[69773]: 2024-09-21 08:01:12.307126114 +0000 UTC m=+0.667088282 container remove 9dad3528309c83fd094035e50a143009c7faa89269da8d2d32c63327d6a357c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:01:12.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:12 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:12.225+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:12.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:12 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:12.225+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:12.871 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:12 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:12.741+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:12.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:12 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:12.494+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:12.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:12 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:12.494+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:12.978 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:12 smithi123 podman[69859]: 2024-09-21 08:01:12.560534528 +0000 UTC m=+0.015341196 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:12.978 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:12 smithi123 podman[69859]: 2024-09-21 08:01:12.69984796 +0000 UTC m=+0.154654674 container create 8605d92d55dfa88d326f15e05feb734f66510a8ba528d7a23ec3779b85fc0133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T08:01:12.978 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:12 smithi123 podman[69859]: 2024-09-21 08:01:12.901934558 +0000 UTC m=+0.356741225 container init 8605d92d55dfa88d326f15e05feb734f66510a8ba528d7a23ec3779b85fc0133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T08:01:12.978 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:12 smithi123 podman[69859]: 2024-09-21 08:01:12.905244723 +0000 UTC m=+0.360051391 container start 8605d92d55dfa88d326f15e05feb734f66510a8ba528d7a23ec3779b85fc0133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:01:13.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:12 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:12.699+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:13.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:12 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:12.699+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:13.348 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:13 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:13.135+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:13.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:13 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:13.208+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:13.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:13 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:13.208+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:13.349 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:12 smithi123 podman[69859]: 2024-09-21 08:01:12.97681121 +0000 UTC m=+0.431617899 container attach 8605d92d55dfa88d326f15e05feb734f66510a8ba528d7a23ec3779b85fc0133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:01:13.349 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:13 smithi123 podman[69859]: 2024-09-21 08:01:13.095820882 +0000 UTC m=+0.550627553 container died 8605d92d55dfa88d326f15e05feb734f66510a8ba528d7a23ec3779b85fc0133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T08:01:13.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:13.214+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:13.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:13.259+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:13.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:13.259+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:13.630 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T08:01:13.652 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:13 smithi123 podman[69882]: 2024-09-21 08:01:13.613756265 +0000 UTC m=+0.511737654 container remove 8605d92d55dfa88d326f15e05feb734f66510a8ba528d7a23ec3779b85fc0133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:13.652 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:13 smithi123 systemd[1]: ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T08:01:13.653 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:13 smithi123 systemd[1]: Stopped Ceph osd.4 for 679a927c-77ea-11ef-baf5-efdc52797490. 2024-09-21T08:01:13.653 INFO:journalctl@ceph.osd.4.smithi123.stdout:Sep 21 08:01:13 smithi123 systemd[1]: ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.4.service: Consumed 4min 59.174s CPU time. 2024-09-21T08:01:13.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:13.668 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T08:01:13.668 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T08:01:13.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.5 2024-09-21T08:01:13.782 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:13 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:13.489+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:13.782 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:13 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:13.489+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:13.979 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:13 smithi187 systemd[1]: Stopping Ceph osd.5 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:13.979 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:13.699+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:13.979 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:13.699+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:14.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:13 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:13.781+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:14.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:13 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:13.781+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:14.269 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:14 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:14.169+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:14.269 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:13.976+0000 7f693abe4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:14.269 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:13.976+0000 7f693abe4640 -1 osd.5 79 *** Got signal Terminated *** 2024-09-21T08:01:14.270 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:13 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:13.976+0000 7f693abe4640 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:14.270 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:14 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:14.223+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:14.270 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:14 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:14.223+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:14.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:14 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:14.141+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:14.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:14 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:14.215+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:14.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:14 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:14.215+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:14.812 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:14.538+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:14.812 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:14.538+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:15.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:14 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:14.721+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:15.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:14 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:14.721+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:15.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:14.811+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:15.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:14.811+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:15.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:15 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:15.125+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:15.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:15 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:15.175+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:15.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:15 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:15.175+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:15.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:15 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:15.147+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:15.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:15 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:15.202+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:15.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:15 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:15.202+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:15.791 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:15 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:15.493+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:15.791 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:15 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:15.493+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:16.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:15 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:15.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:16.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:15 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:15.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:16.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:15 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:15.790+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:16.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:15 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:15.790+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:16.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:16 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:16.117+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:16.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:16 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:16.157+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:16.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:16 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:16.157+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:16.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:16 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:16.170+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:16.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:16 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:16.235+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:16.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:16 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:16.235+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:16.831 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:16 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:16.517+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:16.831 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:16 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:16.517+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:17.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:16 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:16.734+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:17.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:16 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:16.734+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:17.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:16 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:16.734+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:17.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:16 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:16.830+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:17.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:16 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:16.830+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:17.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:17.100+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:17.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:17.194+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:17.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:17.194+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:17.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:17.194+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:51.585678+0000 front 2024-09-21T08:00:51.585708+0000 (oldest deadline 2024-09-21T08:01:16.285836+0000) 2024-09-21T08:01:17.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:17 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:17.135+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:17.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:17 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:17.135+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:17.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:17 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:17.224+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:17.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:17 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:17.224+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:17.868 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:17 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:17.509+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:17.869 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:17 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:17.509+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:18.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:17.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:18.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:17.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:18.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:17 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:17.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:18.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:17 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:17.867+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:18.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:17 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:17.867+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:18.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:18.082+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:18.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:18.082+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:18.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:18.204+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:34.683491+0000 front 2024-09-21T08:00:34.683762+0000 (oldest deadline 2024-09-21T08:00:59.884052+0000) 2024-09-21T08:01:18.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:18.204+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.584874+0000 front 2024-09-21T08:00:44.585010+0000 (oldest deadline 2024-09-21T08:01:10.484909+0000) 2024-09-21T08:01:18.520 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5[45020]: 2024-09-21T08:01:18.204+0000 7f69331c7640 -1 osd.5 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:51.585678+0000 front 2024-09-21T08:00:51.585708+0000 (oldest deadline 2024-09-21T08:01:16.285836+0000) 2024-09-21T08:01:18.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:18 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:18.101+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:18.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:18 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:18.101+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:18.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:18 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:18.269+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:18.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:18 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:18.269+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:18.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:18 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:18.269+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:18.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:18 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:18.484+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:18.958 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:18 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:18.484+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:18.958 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:18 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:18.484+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:19.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:18.689+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:19.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:18.689+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:19.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:18 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:18.689+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:19.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:19.077+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:19.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:19.077+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:19.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:19.290+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:19.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:19.290+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:19.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:19 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:19.290+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:19.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:18 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:18.911+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:19.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:18 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:18.911+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:19.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:19.117+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:19.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:19.117+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:19.812 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:19 smithi187 podman[69198]: 2024-09-21 08:01:19.535052407 +0000 UTC m=+5.667068091 container died e660f0a94c11eda69bd68c6e5094277af9ecb91b3a17c9ec34dc084fa16a490c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T08:01:19.812 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:19.677+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:19.812 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:19.677+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:19.813 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:19 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:19.677+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:19.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:19.505+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:19.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:19.505+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:19.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:19.505+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:20.077 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:19 smithi187 podman[69198]: 2024-09-21 08:01:19.910319231 +0000 UTC m=+6.042334902 container cleanup e660f0a94c11eda69bd68c6e5094277af9ecb91b3a17c9ec34dc084fa16a490c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:01:20.077 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:19 smithi187 bash[69198]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5 2024-09-21T08:01:20.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:19.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:20.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:19.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:20.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:19 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:19.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:20.519 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69217]: 2024-09-21 08:01:20.178196336 +0000 UTC m=+0.638563809 container remove e660f0a94c11eda69bd68c6e5094277af9ecb91b3a17c9ec34dc084fa16a490c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T08:01:20.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:20 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:20.075+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:20.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:20 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:20.075+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:20.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:20 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:20.115+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:20.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:20 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:20.115+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:20.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:20 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:20.245+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:20.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:20 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:20.245+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:20.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:20 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:20.245+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:20.849 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:20 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:20.650+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:20.849 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:20 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:20.650+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:20.849 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:20 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:20.650+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:20.849 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69308]: 2024-09-21 08:01:20.42501555 +0000 UTC m=+0.015920435 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:20.850 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69308]: 2024-09-21 08:01:20.537801654 +0000 UTC m=+0.128706543 container create 342c41ea7ec18a88ff7192329c70db7a42c395cfa8b9b447a6c565bb22de4b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T08:01:20.850 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69308]: 2024-09-21 08:01:20.765304623 +0000 UTC m=+0.356209507 container init 342c41ea7ec18a88ff7192329c70db7a42c395cfa8b9b447a6c565bb22de4b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T08:01:20.850 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69308]: 2024-09-21 08:01:20.768590458 +0000 UTC m=+0.359495345 container start 342c41ea7ec18a88ff7192329c70db7a42c395cfa8b9b447a6c565bb22de4b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T08:01:20.850 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69308]: 2024-09-21 08:01:20.848440379 +0000 UTC m=+0.439345278 container attach 342c41ea7ec18a88ff7192329c70db7a42c395cfa8b9b447a6c565bb22de4b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:01:20.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:20.546+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:20.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:20.546+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:20.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:20.546+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:21.243 INFO:journalctl@ceph.osd.5.smithi187.stdout:Sep 21 08:01:20 smithi187 podman[69308]: 2024-09-21 08:01:20.953336326 +0000 UTC m=+0.544241211 container died 342c41ea7ec18a88ff7192329c70db7a42c395cfa8b9b447a6c565bb22de4b57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:21.244 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:21 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:21.072+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:21.244 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:21 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:21.072+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:21.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:21 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:21.094+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:21.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:21 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:21.094+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:21.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:21 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:21.262+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:21.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:21 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:21.262+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:21.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:21 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:21.262+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:21.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:20.895+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:21.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:20.895+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:21.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:20.895+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:21.541 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T08:01:21.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:21.580 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T08:01:21.580 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T08:01:21.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.6 2024-09-21T08:01:21.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:21 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:21.532+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:21.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:21 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:21.532+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:21.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:21 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:21.532+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:21.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:21 smithi060 systemd[1]: Stopping Ceph osd.6 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:22.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:21 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:21.676+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:22.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:21 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:21.676+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:22.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:21 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:21.676+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:22.371 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:22.022+0000 7efdb8ec4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:22.372 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:22.022+0000 7efdb8ec4640 -1 osd.6 79 *** Got signal Terminated *** 2024-09-21T08:01:22.372 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:22.022+0000 7efdb8ec4640 -1 osd.6 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:22.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:21 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:21.882+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:22.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:21 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:21.882+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:22.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:21 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:21.882+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:22.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:22 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:22.089+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:22.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:22 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:22.090+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:22.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:22 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:22.125+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:22.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:22 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:22.125+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:22.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:22 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:22.232+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:22.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:22 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:22.232+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:22.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:22 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:22.232+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:22.839 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:22.552+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:22.839 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:22.552+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:22.839 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:22.552+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:23.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:22 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:22.704+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:23.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:22 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:22.704+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:23.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:22 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:22.704+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:23.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:22.838+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:23.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:22.838+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:23.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:22 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:22.838+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:23.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:23 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:23.082+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:23.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:23 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:23.082+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:23.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:23 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:23.104+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:23.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:23 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:23.104+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:23.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:23 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:23.264+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:23.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:23 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:23.264+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:23.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:23 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:23.264+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:23.869 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:23.516+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:23.869 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:23.516+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:23.869 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:23.516+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:24.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:23 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:23.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:24.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:23 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:23.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:24.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:23 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:23.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:24.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:23.868+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:24.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:23.868+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:24.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:23 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:23.868+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:24.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:24 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:24.066+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:24.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:24 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:24.066+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:24.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:24 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:24.145+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:24.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:24 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:24.145+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:24.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:24 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:24.261+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:24.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:24 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:24.261+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:24.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:24 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:24.261+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:24.865 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:24 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:24.530+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:24.865 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:24 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:24.530+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:24.865 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:24 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:24.530+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:25.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:24 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:24.675+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:25.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:24 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:24.675+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:25.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:24 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:24.675+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:25.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:24 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:24.863+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:25.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:24 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:24.863+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:25.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:24 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:24.863+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:25.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:25 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:25.105+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:25.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:25 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:25.105+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:25.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:25.133+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:25.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:25.133+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:25.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:25.244+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:25.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:25.244+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:25.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:25.244+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:25.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:25.512+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:25.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:25.512+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:25.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:25.512+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:25.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:25.512+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.077860+0000 front 2024-09-21T08:01:02.077760+0000 (oldest deadline 2024-09-21T08:01:24.977793+0000) 2024-09-21T08:01:26.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:25 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:25.717+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:26.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:25 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:25.717+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:26.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:25 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:25.717+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:26.302 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:26 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:26.130+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:26.302 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:26 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:26.130+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:26.302 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:26 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:26.130+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:26.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:25.897+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:26.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:25.897+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:26.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:25.897+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:26.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:25 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:25.897+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:26.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:26.161+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:26.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:26.161+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:26.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:26.231+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:26.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:26.231+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:26.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:26.231+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:26.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:26 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:26.231+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:26.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:26.537+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:35.174281+0000 front 2024-09-21T08:00:35.174587+0000 (oldest deadline 2024-09-21T08:01:00.474523+0000) 2024-09-21T08:01:26.871 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:26.537+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:43.975685+0000 front 2024-09-21T08:00:43.975798+0000 (oldest deadline 2024-09-21T08:01:08.675654+0000) 2024-09-21T08:01:26.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:26.537+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:52.077396+0000 front 2024-09-21T08:00:52.077208+0000 (oldest deadline 2024-09-21T08:01:17.977009+0000) 2024-09-21T08:01:26.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6[59912]: 2024-09-21T08:01:26.537+0000 7efdb14a7640 -1 osd.6 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.077860+0000 front 2024-09-21T08:01:02.077760+0000 (oldest deadline 2024-09-21T08:01:24.977793+0000) 2024-09-21T08:01:27.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:26 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:26.713+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:27.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:26 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:26.713+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:27.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:26 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:26.713+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:27.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:26.921+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:27.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:26.921+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:27.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:26.921+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:27.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:26 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:26.921+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:27.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:27 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:27.107+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:27.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:27 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:27.107+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:27.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:27 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:27.107+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:27.598 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:27.116+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:27.599 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:27.116+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:27.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:27.208+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:27.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:27.208+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:27.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:27.208+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:27.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:27 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:27.208+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:27.872 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:27 smithi060 podman[89413]: 2024-09-21 08:01:27.606909476 +0000 UTC m=+5.826230331 container died 3c7846e481bd2e0f572c4423c9ec41f56ff4d049584845f18efcf1fd6997640b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:28.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:27 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:27.709+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:28.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:27 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:27.709+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:28.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:27 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:27.709+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:28.297 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:27 smithi060 podman[89413]: 2024-09-21 08:01:27.922047121 +0000 UTC m=+6.141367976 container cleanup 3c7846e481bd2e0f572c4423c9ec41f56ff4d049584845f18efcf1fd6997640b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T08:01:28.298 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:27 smithi060 bash[89413]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6 2024-09-21T08:01:28.298 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:27.873+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:28.298 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:27.873+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:28.298 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:27.873+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:28.298 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:27 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:27.873+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:28.348 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:28.255+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:28.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:28.255+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:28.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:28.255+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:28.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:28.255+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:28.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:28.076+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:28.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:28.076+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:28.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:28.076+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:28.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:28.148+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:28.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:28.148+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:28.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:28.148+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:28.621 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:28 smithi060 podman[89428]: 2024-09-21 08:01:28.296854754 +0000 UTC m=+0.683859132 container remove 3c7846e481bd2e0f572c4423c9ec41f56ff4d049584845f18efcf1fd6997640b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:28 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:28.872+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:28 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:28.872+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:28 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:28.872+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:28 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:28.872+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:28 smithi060 podman[89514]: 2024-09-21 08:01:28.594645323 +0000 UTC m=+0.016470599 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:28 smithi060 podman[89514]: 2024-09-21 08:01:28.695178581 +0000 UTC m=+0.117003833 container create fc92b5974821df99a0533a03400219252107f6df245202cb83651f979cb96799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:01:28.961 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:28 smithi060 podman[89514]: 2024-09-21 08:01:28.96001926 +0000 UTC m=+0.381844524 container init fc92b5974821df99a0533a03400219252107f6df245202cb83651f979cb96799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T08:01:29.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:28.736+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:29.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:28.736+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:29.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:28 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:28.736+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:29.348 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:29.044+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:29.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:29.044+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:29.349 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:29.044+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:29.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:29.239+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:29.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:29.239+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:29.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:29.239+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:29.349 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:29 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:29.239+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:29.372 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:28 smithi060 podman[89514]: 2024-09-21 08:01:28.963529158 +0000 UTC m=+0.385354414 container start fc92b5974821df99a0533a03400219252107f6df245202cb83651f979cb96799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T08:01:29.372 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:29 smithi060 podman[89514]: 2024-09-21 08:01:29.051770651 +0000 UTC m=+0.473595915 container attach fc92b5974821df99a0533a03400219252107f6df245202cb83651f979cb96799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T08:01:29.372 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 21 08:01:29 smithi060 podman[89514]: 2024-09-21 08:01:29.164986352 +0000 UTC m=+0.586811621 container died fc92b5974821df99a0533a03400219252107f6df245202cb83651f979cb96799 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:01:29.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:29.135+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:29.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:29.135+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:29.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:29.135+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:29.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T08:01:29.767 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:29.767 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T08:01:29.767 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T08:01:29.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.7 2024-09-21T08:01:30.099 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:29 smithi123 systemd[1]: Stopping Ceph osd.7 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:30.099 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:30.025+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:30.099 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:30.025+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:30.099 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:30.025+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:30.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:29 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:29.909+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:30.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:29 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:29.909+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:30.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:29 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:29.909+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:30.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:29 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:29.909+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:30.170 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:29.775+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:30.170 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:29.775+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:30.170 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:29 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:29.775+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:30.366 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:30.106+0000 7fdb96754640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:30.366 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:30.106+0000 7fdb96754640 -1 osd.7 79 *** Got signal Terminated *** 2024-09-21T08:01:30.366 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:30.106+0000 7fdb96754640 -1 osd.7 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:30.366 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:30.252+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:30.366 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:30.252+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:30.366 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:30.252+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:30.367 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:30 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:30.252+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:30.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:30.168+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:30.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:30.168+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:30.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:30.168+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:31.121 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:30 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:30.860+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:31.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:30 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:30.860+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:31.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:30 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:30.860+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:31.122 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:30 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:30.860+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:31.187 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:30.769+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:31.187 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:30.769+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:31.187 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:30 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:30.769+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:31.286 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:31.000+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:31.286 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:31.000+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:31.286 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:31.000+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:31.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:31 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:31.185+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:31.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:31 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:31.185+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:31.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:31 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:31.185+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:31.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:31.284+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:31.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:31.284+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:31.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:31.284+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:31.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:31.284+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:32.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:31 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:31.733+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:32.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:31 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:31.733+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:32.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:31 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:31.733+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:32.313 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:31.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:32.313 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:31.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:32.314 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:31 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:31.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:32.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:31 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:31.889+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:32.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:31 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:31.889+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:32.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:31 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:31.889+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:32.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:31 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:31.889+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:32.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:32.176+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:32.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:32.176+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:32.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:32.176+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:32.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:32.176+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:32.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:32.312+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:32.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:32.312+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:32.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:32.312+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:32.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:32.312+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:32.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:32.312+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:33.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:32.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:33.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:32.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:33.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:32 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:32.711+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:33.299 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:32.969+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:33.299 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:32.969+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:33.299 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:32.969+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:33.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:32 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:32.901+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:33.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:32 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:32.901+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:33.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:32 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:32.901+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:33.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:32 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:32.901+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:33.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:33.142+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:33.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:33.142+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:33.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:33.142+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:33.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:33.142+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:33.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:33.297+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:33.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:33.297+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:33.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:33.297+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:33.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:33.297+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:33.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:33.297+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:34.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:33.720+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:34.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:33.720+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:34.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:33 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:33.720+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:34.334 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:33.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:34.334 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:33.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:34.334 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:33.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:34.334 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:33 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:33.982+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:08.002782+0000 front 2024-09-21T08:01:08.002751+0000 (oldest deadline 2024-09-21T08:01:33.302896+0000) 2024-09-21T08:01:34.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:33 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:33.946+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:34.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:33 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:33.946+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:34.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:33 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:33.946+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:34.373 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:33 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:33.946+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:34.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:34.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:34.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:34.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:34.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:34.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:34.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:34.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:34.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:34.331+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:34.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:34.331+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:34.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:34.331+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:34.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:34.331+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:34.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:34.331+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:35.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:34.748+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:35.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:34.748+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:35.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:34.748+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:35.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:34 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:34.748+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:35.316 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:34.983+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:45.799398+0000 front 2024-09-21T08:00:45.799362+0000 (oldest deadline 2024-09-21T08:01:08.699514+0000) 2024-09-21T08:01:35.316 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:34.983+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:50.400471+0000 front 2024-09-21T08:00:50.400562+0000 (oldest deadline 2024-09-21T08:01:16.300551+0000) 2024-09-21T08:01:35.316 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:34.983+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.201822+0000 front 2024-09-21T08:00:59.201808+0000 (oldest deadline 2024-09-21T08:01:28.002403+0000) 2024-09-21T08:01:35.316 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:34 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7[51161]: 2024-09-21T08:01:34.983+0000 7fdb8ed37640 -1 osd.7 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:08.002782+0000 front 2024-09-21T08:01:08.002751+0000 (oldest deadline 2024-09-21T08:01:33.302896+0000) 2024-09-21T08:01:35.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:34.948+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:35.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:34.948+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:35.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:34.948+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:35.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:34 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:34.948+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:35.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:35.184+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:35.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:35.184+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:35.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:35.184+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:35.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:35.184+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:35.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:35 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:35.314+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:35.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:35 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:35.314+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:35.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:35 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:35.314+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:35.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:35 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:35.314+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:35.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:35 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:35.314+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:36.016 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:35 smithi123 podman[69962]: 2024-09-21 08:01:35.699635122 +0000 UTC m=+5.731985899 container died e70ced9bd12fce618efbdae61a748c3ec1993bb3821183ac87cf3cff5c5a0b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T08:01:36.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:35.752+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:36.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:35.752+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:36.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:35.752+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:36.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:35 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:35.752+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:36.287 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[69962]: 2024-09-21 08:01:36.015411997 +0000 UTC m=+6.047762762 container cleanup e70ced9bd12fce618efbdae61a748c3ec1993bb3821183ac87cf3cff5c5a0b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T08:01:36.288 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 bash[69962]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7 2024-09-21T08:01:36.288 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[69989]: 2024-09-21 08:01:36.208375909 +0000 UTC m=+0.503611236 container remove e70ced9bd12fce618efbdae61a748c3ec1993bb3821183ac87cf3cff5c5a0b78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T08:01:36.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:35 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:35.978+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:36.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:35 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:35.978+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:36.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:35 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:35.978+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:36.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:35 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:35.978+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:36.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:35 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:35.978+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:36.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:36.187+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:36.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:36.187+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:36.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:36.187+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:36.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:36.187+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:36.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:36.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:36.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:36.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:36.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:36.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:36.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:36.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:36.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:36.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:36.872 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[70078]: 2024-09-21 08:01:36.509381389 +0000 UTC m=+0.015637029 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:36.872 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[70078]: 2024-09-21 08:01:36.651279235 +0000 UTC m=+0.157534913 container create c0872c60ea48c8ed8cbe0375e7b33d43a0cc2a7cb48203d5f84e8a57e090c082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:01:36.872 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[70078]: 2024-09-21 08:01:36.870647593 +0000 UTC m=+0.376903234 container init c0872c60ea48c8ed8cbe0375e7b33d43a0cc2a7cb48203d5f84e8a57e090c082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T08:01:37.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:36.708+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:37.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:36.708+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:37.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:36.708+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:37.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:36 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:36.708+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:37.287 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[70078]: 2024-09-21 08:01:36.874661495 +0000 UTC m=+0.380917128 container start c0872c60ea48c8ed8cbe0375e7b33d43a0cc2a7cb48203d5f84e8a57e090c082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:37.287 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:36 smithi123 podman[70078]: 2024-09-21 08:01:36.95354335 +0000 UTC m=+0.459798991 container attach c0872c60ea48c8ed8cbe0375e7b33d43a0cc2a7cb48203d5f84e8a57e090c082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:01:37.287 INFO:journalctl@ceph.osd.7.smithi123.stdout:Sep 21 08:01:37 smithi123 podman[70078]: 2024-09-21 08:01:37.071239286 +0000 UTC m=+0.577494929 container died c0872c60ea48c8ed8cbe0375e7b33d43a0cc2a7cb48203d5f84e8a57e090c082 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T08:01:37.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:36 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:36.966+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:37.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:36 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:36.966+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:37.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:36 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:36.966+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:37.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:36 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:36.966+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:37.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:36 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:36.966+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:37.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:37.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:37.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:37.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:37.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:37.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:37.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:37.159+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:37.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:37 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:37.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:37.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:37 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:37.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:37.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:37 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:37.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:37.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:37 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:37.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:37.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:37 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:37.285+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:37.689 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T08:01:37.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:37.728 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T08:01:37.728 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T08:01:37.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.8 2024-09-21T08:01:38.019 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:37 smithi187 systemd[1]: Stopping Ceph osd.8 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:38.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:37.672+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:38.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:37.672+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:38.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:37.672+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:38.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:37 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:37.672+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:38.374 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:37 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:37.927+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:38.374 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:37 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:37.927+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:38.374 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:37 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:37.927+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:38.374 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:37 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:37.927+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:38.374 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:37 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:37.927+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:38.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.079+0000 7f6cda178640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:38.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.079+0000 7f6cda178640 -1 osd.8 79 *** Got signal Terminated *** 2024-09-21T08:01:38.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.079+0000 7f6cda178640 -1 osd.8 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:38.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.119+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:38.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.119+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:38.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.119+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:38.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:38.119+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:38.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:38 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:38.315+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:38.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:38 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:38.315+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:38.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:38 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:38.315+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:38.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:38 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:38.315+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:38.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:38 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:38.315+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:39.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:38.664+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:39.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:38.664+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:39.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:38.664+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:39.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:38.664+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:39.273 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:38 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:38.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:39.273 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:38 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:38.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:39.273 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:38 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:38.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:39.273 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:38 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:38.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:39.273 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:38 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:38.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:39.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:39.092+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:39.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:39.092+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:39.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:39.092+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:39.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:39.092+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:39.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:39.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:39.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:39.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:39.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:39.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:39.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:39.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:39.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:39 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:39.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:40.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:39.657+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:40.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:39.657+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:40.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:39.657+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:40.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:39 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:39.657+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:40.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:40 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:39.998+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:40.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:40 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:39.998+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:40.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:40 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:39.998+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:40.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:40 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:39.998+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:40.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:40 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:39.998+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:40.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:40 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:39.998+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:40.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:40.046+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:40.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:40.046+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:40.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:40.046+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:40.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:40.046+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:40.848 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:40 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:40.370+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:40.848 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:40 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:40.370+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:40.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:40 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:40.370+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:40.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:40 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:40.370+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:40.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:40 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:40.370+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:41.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:40.633+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:41.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:40.633+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:41.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:40.633+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:41.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:40 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:40.633+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:41.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:41.030+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:41.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:41.030+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:41.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:41.030+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:41.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:41.030+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:41.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:41.030+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:41.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:41 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:41.030+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:41.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:41.087+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:41.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:41.087+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:41.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:41.087+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:41.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:41.087+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:41.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:41 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:41.327+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:41.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:41 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:41.327+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:41.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:41 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:41.327+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:41.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:41 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:41.327+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:41.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:41 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:41.327+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:42.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:41.656+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:42.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:41.656+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:42.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:41.656+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:42.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:41.656+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:42.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:41 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:41.656+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:42.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:42 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:42.050+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:42.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:42 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:42.050+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:42.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:42 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:42.050+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:42.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:42 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:42.050+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:42.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:42 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:42.050+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:42.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:42 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:42.050+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:42.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:42.049+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:42.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:42.049+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:42.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:42.049+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:42.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:42.049+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:42.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:42.287+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:42.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:42.287+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:42.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:42.287+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:42.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:42.287+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:42.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:42 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:42.287+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:43.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:42.703+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:43.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:42.703+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:43.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:42.703+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:43.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:42.703+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:43.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:42 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:42.703+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:43.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.011+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:43.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.011+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:43.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.011+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:43.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.011+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:43.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.011+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:43.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.011+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:43.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:43.022+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:47.090895+0000 front 2024-09-21T08:00:47.090821+0000 (oldest deadline 2024-09-21T08:01:08.790998+0000) 2024-09-21T08:01:43.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:43.022+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.493865+0000 front 2024-09-21T08:00:54.493726+0000 (oldest deadline 2024-09-21T08:01:17.993930+0000) 2024-09-21T08:01:43.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:43.022+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:00.295394+0000 front 2024-09-21T08:01:00.295381+0000 (oldest deadline 2024-09-21T08:01:25.595281+0000) 2024-09-21T08:01:43.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:43.022+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:07.296454+0000 front 2024-09-21T08:01:07.296397+0000 (oldest deadline 2024-09-21T08:01:31.996547+0000) 2024-09-21T08:01:43.520 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8[51184]: 2024-09-21T08:01:43.022+0000 7f6cd275b640 -1 osd.8 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:17.798327+0000 front 2024-09-21T08:01:17.798361+0000 (oldest deadline 2024-09-21T08:01:42.498539+0000) 2024-09-21T08:01:43.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:43 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:43.299+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:43.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:43 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:43.299+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:43.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:43 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:43.299+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:43.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:43 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:43.299+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:43.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:43 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:43.299+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:43.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:43 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:43.299+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:43.882 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 podman[69423]: 2024-09-21 08:01:43.583903311 +0000 UTC m=+5.654700559 container died 0e2e0dd77b9d7276dd553712d7b5d421ff7c1ab6a79ec433e9339676b9851941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T08:01:43.882 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:43.683+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:43.882 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:43.683+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:43.882 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:43.683+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:43.882 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:43.683+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:43.882 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:43 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:43.683+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:44.206 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 podman[69423]: 2024-09-21 08:01:43.979224982 +0000 UTC m=+6.050022188 container cleanup 0e2e0dd77b9d7276dd553712d7b5d421ff7c1ab6a79ec433e9339676b9851941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T08:01:44.206 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:43 smithi187 bash[69423]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8 2024-09-21T08:01:44.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:44.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:44.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:44.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:44.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:44.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:43 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:43.972+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:44.519 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69441]: 2024-09-21 08:01:44.205493537 +0000 UTC m=+0.614704084 container remove 0e2e0dd77b9d7276dd553712d7b5d421ff7c1ab6a79ec433e9339676b9851941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T08:01:44.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:44.303+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:44.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:44.303+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:44.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:44.303+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:44.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:44.303+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:44.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:44.303+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:44.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:44 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:44.303+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:44.859 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:44.647+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:44.647+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:44.647+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:44.647+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:44.647+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69527]: 2024-09-21 08:01:44.444049893 +0000 UTC m=+0.015912770 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69527]: 2024-09-21 08:01:44.556445218 +0000 UTC m=+0.128308086 container create 75d2acd78e85298fbc873ead7736fb1b82ecb029609e7981a748ecd3c6ccb213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69527]: 2024-09-21 08:01:44.775837669 +0000 UTC m=+0.347700542 container init 75d2acd78e85298fbc873ead7736fb1b82ecb029609e7981a748ecd3c6ccb213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69527]: 2024-09-21 08:01:44.779437744 +0000 UTC m=+0.351300620 container start 75d2acd78e85298fbc873ead7736fb1b82ecb029609e7981a748ecd3c6ccb213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T08:01:44.860 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69527]: 2024-09-21 08:01:44.858714587 +0000 UTC m=+0.430577459 container attach 75d2acd78e85298fbc873ead7736fb1b82ecb029609e7981a748ecd3c6ccb213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T08:01:45.269 INFO:journalctl@ceph.osd.8.smithi187.stdout:Sep 21 08:01:44 smithi187 podman[69527]: 2024-09-21 08:01:44.973138663 +0000 UTC m=+0.545001532 container died 75d2acd78e85298fbc873ead7736fb1b82ecb029609e7981a748ecd3c6ccb213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:01:45.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:44 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:44.958+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:45.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:44 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:44.958+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:45.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:44 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:44.958+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:45.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:44 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:44.958+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:45.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:44 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:44.958+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:45.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:44 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:44.958+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:45.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T08:01:45.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:45 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:45.311+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:45.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:45 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:45.311+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:45.600 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:45 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:45.311+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:45.600 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:45 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:45.311+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:45.600 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:45 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:45.311+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:45.600 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:45 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:45.311+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:45.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:45.638 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T08:01:45.638 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T08:01:45.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.9 2024-09-21T08:01:45.844 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:45 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:45.620+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:45.844 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:45 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:45.620+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:45.844 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:45 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:45.620+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:45.844 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:45 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:45.620+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:45.844 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:45 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:45.620+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:45.959 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 systemd[1]: Stopping Ceph osd.9 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:45.959 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.912+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.912+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.912+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.912+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.912+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.912+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.957+0000 7f063a25e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.957+0000 7f063a25e640 -1 osd.9 79 *** Got signal Terminated *** 2024-09-21T08:01:45.960 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:45 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:45.957+0000 7f063a25e640 -1 osd.9 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:46.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:46 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:46.344+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:46.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:46 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:46.344+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:46.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:46 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:46.344+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:46.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:46 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:46.344+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:46.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:46 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:46.344+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:46.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:46 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:46.344+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:47.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:46 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:46.594+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:47.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:46 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:46.594+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:47.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:46 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:46.594+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:47.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:46 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:46.594+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:47.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:46 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:46.594+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:47.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:46 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:46.956+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:47.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:46 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:46.956+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:47.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:46 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:46.956+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:47.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:46 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:46.956+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:47.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:46 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:46.956+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:47.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:46 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:46.956+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:47.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:47 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:47.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:47.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:47 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:47.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:47.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:47 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:47.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:47.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:47 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:47.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:47.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:47 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:47.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:47.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:47 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:47.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:48.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:47 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:47.597+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:48.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:47 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:47.597+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:48.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:47 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:47.597+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:48.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:47 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:47.597+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:48.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:47 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:47.597+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:48.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:47 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:47.928+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:48.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:47 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:47.928+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:48.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:47 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:47.928+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:48.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:47 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:47.928+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:48.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:47 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:47.928+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:48.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:47 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:47.928+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:48.848 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:48 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:48.353+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:48.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:48 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:48.353+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:48.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:48 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:48.353+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:48.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:48 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:48.353+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:48.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:48 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:48.353+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:48.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:48 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:48.353+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:49.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:48.562+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:49.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:48.562+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:49.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:48.562+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:49.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:48.562+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:49.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:48.562+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:49.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:48.562+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:49.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:48 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:48.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:49.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:48 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:48.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:49.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:48 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:48.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:49.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:48 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:48.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:49.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:48 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:48.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:49.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:48 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:48.942+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:49.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:49 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:49.336+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:49.693 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:49 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:49.336+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:49.693 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:49 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:49.336+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:49.693 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:49 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:49.336+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:49.693 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:49 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:49.336+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:49.693 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:49 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:49.336+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:50.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:49 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:49.531+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:50.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:49 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:49.531+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:50.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:49 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:49.531+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:50.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:49 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:49.531+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:50.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:49 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:49.531+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:50.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:49 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:49.531+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:50.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:49 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:49.908+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:50.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:49 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:49.908+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:50.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:49 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:49.908+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:50.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:49 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:49.908+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:50.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:49 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:49.908+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:50.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:49 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:49.908+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:50.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:50 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:50.305+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:50.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:50 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:50.305+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:50.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:50 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:50.305+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:50.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:50 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:50.305+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:50.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:50 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:50.305+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:50.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:50 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:50.305+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:51.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:50.552+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:51.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:50.552+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:51.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:50.552+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:51.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:50.552+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:51.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:50.552+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:51.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:50 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:50.552+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:51.371 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:50 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:50.952+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:38.855746+0000 front 2024-09-21T08:00:38.855785+0000 (oldest deadline 2024-09-21T08:01:04.755996+0000) 2024-09-21T08:01:51.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:50 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:50.952+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:46.957432+0000 front 2024-09-21T08:00:46.957528+0000 (oldest deadline 2024-09-21T08:01:12.857491+0000) 2024-09-21T08:01:51.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:50 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:50.952+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.958982+0000 front 2024-09-21T08:00:53.959160+0000 (oldest deadline 2024-09-21T08:01:19.858841+0000) 2024-09-21T08:01:51.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:50 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:50.952+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:00:59.859313+0000 front 2024-09-21T08:00:59.859343+0000 (oldest deadline 2024-09-21T08:01:25.759468+0000) 2024-09-21T08:01:51.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:50 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:50.952+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.860576+0000 front 2024-09-21T08:01:09.860685+0000 (oldest deadline 2024-09-21T08:01:35.760568+0000) 2024-09-21T08:01:51.372 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:50 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9[66531]: 2024-09-21T08:01:50.952+0000 7f0636849640 -1 osd.9 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.761344+0000 front 2024-09-21T08:01:15.761254+0000 (oldest deadline 2024-09-21T08:01:39.861284+0000) 2024-09-21T08:01:51.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:51.308+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:51.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:51.308+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:51.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:51.308+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:51.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:51.308+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:51.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:51.308+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:51.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:51 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:51.308+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:51.642 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:51 smithi060 podman[89628]: 2024-09-21 08:01:51.380564755 +0000 UTC m=+5.535397944 container died d23d4247457d63a6b79f85cf3ad0c47d11ec7b76a95f01fb21e8b4a8c3342f58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:01:51.993 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:51 smithi060 podman[89628]: 2024-09-21 08:01:51.766055716 +0000 UTC m=+5.920888893 container cleanup d23d4247457d63a6b79f85cf3ad0c47d11ec7b76a95f01fb21e8b4a8c3342f58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T08:01:51.993 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:51 smithi060 bash[89628]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9 2024-09-21T08:01:52.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:51.529+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:52.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:51.529+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:52.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:51.529+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:52.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:51.529+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:52.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:51.529+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:52.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:51 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:51.529+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:52.315 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:51 smithi060 podman[89644]: 2024-09-21 08:01:51.992222829 +0000 UTC m=+0.613757450 container remove d23d4247457d63a6b79f85cf3ad0c47d11ec7b76a95f01fb21e8b4a8c3342f58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-21T08:01:52.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:52.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:52.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:52.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:52.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:52.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:52.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:52 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:52.335+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:52.621 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:52 smithi060 podman[89734]: 2024-09-21 08:01:52.217495424 +0000 UTC m=+0.016342962 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:01:52.621 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:52 smithi060 podman[89734]: 2024-09-21 08:01:52.318043854 +0000 UTC m=+0.116891424 container create 4201937895eb0e31f43c41127a056b7a18389f48ec1436e5ee922b5da8193f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T08:01:52.621 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:52 smithi060 podman[89734]: 2024-09-21 08:01:52.545363044 +0000 UTC m=+0.344210576 container init 4201937895eb0e31f43c41127a056b7a18389f48ec1436e5ee922b5da8193f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T08:01:52.621 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:52 smithi060 podman[89734]: 2024-09-21 08:01:52.548765463 +0000 UTC m=+0.347613001 container start 4201937895eb0e31f43c41127a056b7a18389f48ec1436e5ee922b5da8193f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T08:01:52.621 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:52 smithi060 podman[89734]: 2024-09-21 08:01:52.620245034 +0000 UTC m=+0.419092575 container attach 4201937895eb0e31f43c41127a056b7a18389f48ec1436e5ee922b5da8193f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T08:01:52.871 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:52 smithi060 podman[89734]: 2024-09-21 08:01:52.739892214 +0000 UTC m=+0.538739743 container died 4201937895eb0e31f43c41127a056b7a18389f48ec1436e5ee922b5da8193f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T08:01:53.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:52.556+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:53.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:52.556+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:53.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:52.556+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:53.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:52.556+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:53.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:52.556+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:53.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:52.556+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:53.296 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 21 08:01:53 smithi060 podman[89757]: 2024-09-21 08:01:53.282284545 +0000 UTC m=+0.536069572 container remove 4201937895eb0e31f43c41127a056b7a18389f48ec1436e5ee922b5da8193f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T08:01:53.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T08:01:53.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:01:53.348 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T08:01:53.348 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T08:01:53.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.10 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.350+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 systemd[1]: Stopping Ceph osd.10 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.659+0000 7fcfffa11640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:01:53.661 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.659+0000 7fcfffa11640 -1 osd.10 79 *** Got signal Terminated *** 2024-09-21T08:01:53.662 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:53 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:53.659+0000 7fcfffa11640 -1 osd.10 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:01:54.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:53 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:53.564+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:54.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:53 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:53.564+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:54.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:53 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:53.564+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:54.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:53 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:53.564+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:54.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:53 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:53.564+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:54.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:53 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:53.564+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:54.848 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:54.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:54.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:54.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:54.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:54.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:54.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:54 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:54.376+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:55.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:54 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:54.558+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:55.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:54 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:54.558+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:55.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:54 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:54.558+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:55.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:54 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:54.558+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:55.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:54 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:54.558+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:55.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:54 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:54.558+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:55.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:55 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:55.328+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:55.921 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:55 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:55.559+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:55.921 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:55 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:55.559+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:55.921 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:55 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:55.559+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:55.921 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:55 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:55.559+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:55.921 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:55 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:55.559+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:55.921 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:55 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:55.559+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:56.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:56 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:56.318+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:56.880 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:56 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:56.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:57.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:57 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:57.362+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:58.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:58.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:58.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:58.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:58.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:58.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:58.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:57 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:57.603+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:01:58.598 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:36.046334+0000 front 2024-09-21T08:00:36.046356+0000 (oldest deadline 2024-09-21T08:01:01.346254+0000) 2024-09-21T08:01:58.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:44.847267+0000 front 2024-09-21T08:00:44.847239+0000 (oldest deadline 2024-09-21T08:01:07.647998+0000) 2024-09-21T08:01:58.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:54.951240+0000 front 2024-09-21T08:00:54.951487+0000 (oldest deadline 2024-09-21T08:01:17.851326+0000) 2024-09-21T08:01:58.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-21T08:01:02.552248+0000 front 2024-09-21T08:01:02.552437+0000 (oldest deadline 2024-09-21T08:01:26.052313+0000) 2024-09-21T08:01:58.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:06.052713+0000 front 2024-09-21T08:01:06.052675+0000 (oldest deadline 2024-09-21T08:01:31.952831+0000) 2024-09-21T08:01:58.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:18.354764+0000 front 2024-09-21T08:01:18.354752+0000 (oldest deadline 2024-09-21T08:01:42.454521+0000) 2024-09-21T08:01:58.599 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:58 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10[57859]: 2024-09-21T08:01:58.345+0000 7fcffbffc640 -1 osd.10 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:26.555632+0000 front 2024-09-21T08:01:26.555777+0000 (oldest deadline 2024-09-21T08:01:51.855548+0000) 2024-09-21T08:01:59.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:01:59.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:01:59.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:01:59.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:01:59.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:01:59.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:01:59.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:58 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:58.590+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:01:59.502 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:59 smithi123 podman[70181]: 2024-09-21 08:01:59.194458464 +0000 UTC m=+5.649045371 container died 1a703804ed8edc1d4f1ba8bb5c5632bc6c3c36de159adf643a539c550bff2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:01:59.844 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:59 smithi123 podman[70181]: 2024-09-21 08:01:59.600565005 +0000 UTC m=+6.055151898 container cleanup 1a703804ed8edc1d4f1ba8bb5c5632bc6c3c36de159adf643a539c550bff2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T08:01:59.844 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:59 smithi123 bash[70181]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10 2024-09-21T08:02:00.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:00.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:00.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:00.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:00.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:00.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:00.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:01:59 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:01:59.570+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:00.098 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:01:59 smithi123 podman[70197]: 2024-09-21 08:01:59.843333439 +0000 UTC m=+0.643661801 container remove 1a703804ed8edc1d4f1ba8bb5c5632bc6c3c36de159adf643a539c550bff2704 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:02:00.439 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:02:00 smithi123 podman[70286]: 2024-09-21 08:02:00.055444248 +0000 UTC m=+0.015791922 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:02:00.439 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:02:00 smithi123 podman[70286]: 2024-09-21 08:02:00.186027465 +0000 UTC m=+0.146375173 container create 778689aac42e2879dd903516912511047c1976765dec63b3fcfa80b64dac3b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T08:02:00.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:02:00 smithi123 podman[70286]: 2024-09-21 08:02:00.438426847 +0000 UTC m=+0.398774509 container init 778689aac42e2879dd903516912511047c1976765dec63b3fcfa80b64dac3b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T08:02:00.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:02:00 smithi123 podman[70286]: 2024-09-21 08:02:00.442050061 +0000 UTC m=+0.402397735 container start 778689aac42e2879dd903516912511047c1976765dec63b3fcfa80b64dac3b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T08:02:00.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:02:00 smithi123 podman[70286]: 2024-09-21 08:02:00.521821049 +0000 UTC m=+0.482168736 container attach 778689aac42e2879dd903516912511047c1976765dec63b3fcfa80b64dac3b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:02:00.849 INFO:journalctl@ceph.osd.10.smithi123.stdout:Sep 21 08:02:00 smithi123 podman[70286]: 2024-09-21 08:02:00.627354449 +0000 UTC m=+0.587702114 container died 778689aac42e2879dd903516912511047c1976765dec63b3fcfa80b64dac3b21 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:02:01.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:01.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:01.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:01.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:01.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:01.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:01.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:00 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:00.618+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:01.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T08:02:01.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:01.273 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T08:02:01.273 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T08:02:01.273 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.11 2024-09-21T08:02:01.574 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 systemd[1]: Stopping Ceph osd.11 for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:02.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.572+0000 7f4d79bd5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.572+0000 7f4d79bd5640 -1 osd.11 79 *** Got signal Terminated *** 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.572+0000 7f4d79bd5640 -1 osd.11 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:02.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:01 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:01.663+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:03.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:03.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:03.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:03.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:03.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:03.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:03.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:02 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:02.622+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:04.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:04.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:04.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:04.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:04.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:04.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:04.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:03 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:03.604+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:05.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:05.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:05.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:05.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:05.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:05.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:05.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:04 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:04.591+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:06.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-21T08:00:37.618863+0000 front 2024-09-21T08:00:37.619246+0000 (oldest deadline 2024-09-21T08:01:02.919088+0000) 2024-09-21T08:02:06.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6804 osd.1 since back 2024-09-21T08:00:42.919596+0000 front 2024-09-21T08:00:42.919701+0000 (oldest deadline 2024-09-21T08:01:09.320209+0000) 2024-09-21T08:02:06.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2024-09-21T08:00:53.420979+0000 front 2024-09-21T08:00:53.421002+0000 (oldest deadline 2024-09-21T08:01:16.321039+0000) 2024-09-21T08:02:06.019 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6812 osd.4 since back 2024-09-21T08:01:09.024206+0000 front 2024-09-21T08:01:09.024222+0000 (oldest deadline 2024-09-21T08:01:33.724150+0000) 2024-09-21T08:02:06.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2024-09-21T08:01:15.425162+0000 front 2024-09-21T08:01:15.425312+0000 (oldest deadline 2024-09-21T08:01:41.325380+0000) 2024-09-21T08:02:06.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-21T08:01:24.826374+0000 front 2024-09-21T08:01:24.826396+0000 (oldest deadline 2024-09-21T08:01:48.326463+0000) 2024-09-21T08:02:06.020 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:05 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11[57601]: 2024-09-21T08:02:05.587+0000 7f4d721b8640 -1 osd.11 79 heartbeat_check: no reply from 172.21.15.123:6820 osd.7 since back 2024-09-21T08:01:30.027529+0000 front 2024-09-21T08:01:30.027428+0000 (oldest deadline 2024-09-21T08:01:56.427709+0000) 2024-09-21T08:02:07.241 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:06 smithi187 podman[69641]: 2024-09-21 08:02:06.965691018 +0000 UTC m=+5.500741930 container died dc16ddb0b50be64d530f81304b513cf97d02a9c59111f8a6d89c6ac9f73412fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T08:02:07.519 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:07 smithi187 podman[69641]: 2024-09-21 08:02:07.330449208 +0000 UTC m=+5.865500103 container cleanup dc16ddb0b50be64d530f81304b513cf97d02a9c59111f8a6d89c6ac9f73412fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:02:07.519 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:07 smithi187 bash[69641]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11 2024-09-21T08:02:07.941 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:07 smithi187 podman[69656]: 2024-09-21 08:02:07.623756062 +0000 UTC m=+0.660447858 container remove dc16ddb0b50be64d530f81304b513cf97d02a9c59111f8a6d89c6ac9f73412fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T08:02:08.219 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:07 smithi187 podman[69746]: 2024-09-21 08:02:07.843438728 +0000 UTC m=+0.016105785 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T08:02:08.219 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:07 smithi187 podman[69746]: 2024-09-21 08:02:07.957876696 +0000 UTC m=+0.130543788 container create 0fafd8010b7e5d4edd1bef13b794b9883b73bff82576afc7a1f4b537bcaa7086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T08:02:08.219 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:08 smithi187 podman[69746]: 2024-09-21 08:02:08.151745031 +0000 UTC m=+0.324412081 container init 0fafd8010b7e5d4edd1bef13b794b9883b73bff82576afc7a1f4b537bcaa7086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:02:08.219 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:08 smithi187 podman[69746]: 2024-09-21 08:02:08.154915258 +0000 UTC m=+0.327582315 container start 0fafd8010b7e5d4edd1bef13b794b9883b73bff82576afc7a1f4b537bcaa7086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T08:02:08.220 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:08 smithi187 podman[69746]: 2024-09-21 08:02:08.218455704 +0000 UTC m=+0.391122760 container attach 0fafd8010b7e5d4edd1bef13b794b9883b73bff82576afc7a1f4b537bcaa7086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T08:02:08.519 INFO:journalctl@ceph.osd.11.smithi187.stdout:Sep 21 08:02:08 smithi187 podman[69746]: 2024-09-21 08:02:08.339588839 +0000 UTC m=+0.512255894 container died 0fafd8010b7e5d4edd1bef13b794b9883b73bff82576afc7a1f4b537bcaa7086 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:02:08.937 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T08:02:08.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:08.978 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T08:02:08.978 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T08:02:08.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.a 2024-09-21T08:02:09.286 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 08:02:09 smithi060 systemd[1]: Stopping Ceph mds.a for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:09.565 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 08:02:09 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a[73233]: 2024-09-21T08:02:09.284+0000 7fac8b4d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:09.565 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 08:02:09 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a[73233]: 2024-09-21T08:02:09.284+0000 7fac8b4d1640 -1 mds.a *** got signal Terminated *** 2024-09-21T08:02:13.586 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 08:02:13 smithi060 podman[89848]: 2024-09-21 08:02:13.294213706 +0000 UTC m=+4.108617917 container died 837237be24a2db59008a1f09bc63eba0bec496c8bb1d06e4b9b6efe757eb3342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T08:02:13.871 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 08:02:13 smithi060 podman[89848]: 2024-09-21 08:02:13.659075078 +0000 UTC m=+4.473479288 container cleanup 837237be24a2db59008a1f09bc63eba0bec496c8bb1d06e4b9b6efe757eb3342 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T08:02:13.871 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 21 08:02:13 smithi060 bash[89848]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-a 2024-09-21T08:02:14.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T08:02:14.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:14.136 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T08:02:14.137 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T08:02:14.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.d 2024-09-21T08:02:14.621 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 08:02:14 smithi060 systemd[1]: Stopping Ceph mds.d for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:14.621 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 08:02:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d[72194]: 2024-09-21T08:02:14.463+0000 7f354d466640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:14.622 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 08:02:14 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d[72194]: 2024-09-21T08:02:14.463+0000 7f354d466640 -1 mds.d *** got signal Terminated *** 2024-09-21T08:02:15.907 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 08:02:15 smithi060 podman[89980]: 2024-09-21 08:02:15.641206886 +0000 UTC m=+1.282670981 container died cbeeac9bc47cc96296b8fcbe9b3ee3a20901722aa8d2019fdae64f5744af7b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T08:02:16.366 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 08:02:15 smithi060 podman[89980]: 2024-09-21 08:02:15.997058835 +0000 UTC m=+1.638522927 container cleanup cbeeac9bc47cc96296b8fcbe9b3ee3a20901722aa8d2019fdae64f5744af7b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T08:02:16.366 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 21 08:02:15 smithi060 bash[89980]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-d 2024-09-21T08:02:16.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T08:02:16.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:16.617 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T08:02:16.617 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T08:02:16.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.g 2024-09-21T08:02:16.871 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 08:02:16 smithi060 systemd[1]: Stopping Ceph mds.g for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:17.371 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 08:02:16 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-g[72933]: 2024-09-21T08:02:16.975+0000 7fb282d36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:17.371 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 08:02:16 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-g[72933]: 2024-09-21T08:02:16.975+0000 7fb282d36640 -1 mds.g *** got signal Terminated *** 2024-09-21T08:02:19.621 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 08:02:19 smithi060 podman[90103]: 2024-09-21 08:02:19.361076983 +0000 UTC m=+2.518278609 container died a30b05983e16137a9622fef41a3b4642227f04c6433525fafae3778dc21f7e7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:02:19.871 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 08:02:19 smithi060 podman[90103]: 2024-09-21 08:02:19.725885 +0000 UTC m=+2.883086612 container cleanup a30b05983e16137a9622fef41a3b4642227f04c6433525fafae3778dc21f7e7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-g, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T08:02:19.871 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 21 08:02:19 smithi060 bash[90103]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-g 2024-09-21T08:02:20.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T08:02:20.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:20.121 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T08:02:20.121 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T08:02:20.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.j 2024-09-21T08:02:20.371 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 08:02:20 smithi060 systemd[1]: Stopping Ceph mds.j for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:20.871 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 08:02:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j[71816]: 2024-09-21T08:02:20.471+0000 7fdd270a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:20.871 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 08:02:20 smithi060 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j[71816]: 2024-09-21T08:02:20.471+0000 7fdd270a8640 -1 mds.j *** got signal Terminated *** 2024-09-21T08:02:24.773 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 08:02:24 smithi060 podman[90224]: 2024-09-21 08:02:24.480084462 +0000 UTC m=+4.130109444 container died f79407b53b8a2f7e8acb74337d900b2a998949dd94b0c58f90c32c99acd7561c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T08:02:25.121 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 08:02:24 smithi060 podman[90224]: 2024-09-21 08:02:24.872279336 +0000 UTC m=+4.522304363 container cleanup f79407b53b8a2f7e8acb74337d900b2a998949dd94b0c58f90c32c99acd7561c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T08:02:25.122 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 21 08:02:24 smithi060 bash[90224]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-j 2024-09-21T08:02:25.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T08:02:25.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:25.316 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T08:02:25.316 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T08:02:25.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.b 2024-09-21T08:02:25.598 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:02:25 smithi123 systemd[1]: Stopping Ceph mds.b for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:26.098 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:02:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: 2024-09-21T08:02:25.633+0000 7feed322f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:26.099 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:02:25 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b[62997]: 2024-09-21T08:02:25.633+0000 7feed322f640 -1 mds.b *** got signal Terminated *** 2024-09-21T08:02:27.598 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:02:27 smithi123 podman[70403]: 2024-09-21 08:02:27.344433116 +0000 UTC m=+1.833313178 container died 10e6b19890ce8e197e478b3392bcd5b836f1b5b0188a1229d8fbdc3f0ea5ac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T08:02:27.971 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:02:27 smithi123 podman[70403]: 2024-09-21 08:02:27.685978073 +0000 UTC m=+2.174858136 container cleanup 10e6b19890ce8e197e478b3392bcd5b836f1b5b0188a1229d8fbdc3f0ea5ac4a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T08:02:27.971 INFO:journalctl@ceph.mds.b.smithi123.stdout:Sep 21 08:02:27 smithi123 bash[70403]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-b 2024-09-21T08:02:28.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T08:02:28.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:28.154 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T08:02:28.154 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T08:02:28.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.e 2024-09-21T08:02:28.499 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:02:28 smithi123 systemd[1]: Stopping Ceph mds.e for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:28.848 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:02:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e[62459]: 2024-09-21T08:02:28.497+0000 7fb68c2e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:28.849 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:02:28 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e[62459]: 2024-09-21T08:02:28.497+0000 7fb68c2e8640 -1 mds.e *** got signal Terminated *** 2024-09-21T08:02:31.575 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:02:31 smithi123 podman[70523]: 2024-09-21 08:02:31.304126993 +0000 UTC m=+2.934477606 container died d2a69f14520ef63929d0715cb87df21859ac9f15d5a21f979275c7a8878ae698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T08:02:31.848 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:02:31 smithi123 podman[70523]: 2024-09-21 08:02:31.706429669 +0000 UTC m=+3.336780281 container cleanup d2a69f14520ef63929d0715cb87df21859ac9f15d5a21f979275c7a8878ae698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T08:02:31.848 INFO:journalctl@ceph.mds.e.smithi123.stdout:Sep 21 08:02:31 smithi123 bash[70523]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-e 2024-09-21T08:02:32.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T08:02:32.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:32.120 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T08:02:32.120 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T08:02:32.120 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.h 2024-09-21T08:02:32.598 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:02:32 smithi123 systemd[1]: Stopping Ceph mds.h for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:32.598 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:02:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h[62729]: 2024-09-21T08:02:32.434+0000 7f5971c0e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:32.599 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:02:32 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h[62729]: 2024-09-21T08:02:32.434+0000 7f5971c0e640 -1 mds.h *** got signal Terminated *** 2024-09-21T08:02:35.598 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:02:35 smithi123 podman[70643]: 2024-09-21 08:02:35.324687339 +0000 UTC m=+2.989807620 container died aefdfa999a61c5310cd9b9639bbe24232c935a253416527898ce1573db44e6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T08:02:35.962 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:02:35 smithi123 podman[70643]: 2024-09-21 08:02:35.702038337 +0000 UTC m=+3.367158617 container cleanup aefdfa999a61c5310cd9b9639bbe24232c935a253416527898ce1573db44e6a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T08:02:35.962 INFO:journalctl@ceph.mds.h.smithi123.stdout:Sep 21 08:02:35 smithi123 bash[70643]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-h 2024-09-21T08:02:36.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T08:02:36.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:36.168 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T08:02:36.168 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T08:02:36.169 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.k 2024-09-21T08:02:36.515 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 08:02:36 smithi123 systemd[1]: Stopping Ceph mds.k for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:36.848 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 08:02:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k[62180]: 2024-09-21T08:02:36.514+0000 7fc8773e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:36.848 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 08:02:36 smithi123 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k[62180]: 2024-09-21T08:02:36.514+0000 7fc8773e9640 -1 mds.k *** got signal Terminated *** 2024-09-21T08:02:37.957 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 08:02:37 smithi123 podman[70773]: 2024-09-21 08:02:37.669226422 +0000 UTC m=+1.282440648 container died de7b1a3884ec9a54c276aac3e27e430dde68d5ec5e939261434fee0e6d5b8ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T08:02:38.307 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 08:02:38 smithi123 podman[70773]: 2024-09-21 08:02:38.039633362 +0000 UTC m=+1.652847590 container cleanup de7b1a3884ec9a54c276aac3e27e430dde68d5ec5e939261434fee0e6d5b8ac5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T08:02:38.308 INFO:journalctl@ceph.mds.k.smithi123.stdout:Sep 21 08:02:38 smithi123 bash[70773]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-k 2024-09-21T08:02:38.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T08:02:38.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:38.469 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T08:02:38.469 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T08:02:38.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.c 2024-09-21T08:02:38.769 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:02:38 smithi187 systemd[1]: Stopping Ceph mds.c for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:39.030 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:02:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c[62718]: 2024-09-21T08:02:38.896+0000 7f5425325640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:39.030 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:02:38 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c[62718]: 2024-09-21T08:02:38.896+0000 7f5425325640 -1 mds.c *** got signal Terminated *** 2024-09-21T08:02:43.181 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:02:42 smithi187 podman[69849]: 2024-09-21 08:02:42.914404325 +0000 UTC m=+4.253301592 container died b6afb6761bf44c50bcba18baa00fc053c73aff43631f259ad690f7fadcce7851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T08:02:43.519 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:02:43 smithi187 podman[69849]: 2024-09-21 08:02:43.262459425 +0000 UTC m=+4.601356691 container cleanup b6afb6761bf44c50bcba18baa00fc053c73aff43631f259ad690f7fadcce7851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T08:02:43.519 INFO:journalctl@ceph.mds.c.smithi187.stdout:Sep 21 08:02:43 smithi187 bash[69849]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-c 2024-09-21T08:02:43.700 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T08:02:43.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:43.736 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T08:02:43.736 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T08:02:43.736 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.f 2024-09-21T08:02:44.093 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:02:43 smithi187 systemd[1]: Stopping Ceph mds.f for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:44.519 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:02:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f[62448]: 2024-09-21T08:02:44.091+0000 7fd2791cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:44.519 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:02:44 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f[62448]: 2024-09-21T08:02:44.091+0000 7fd2791cc640 -1 mds.f *** got signal Terminated *** 2024-09-21T08:02:47.551 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:02:47 smithi187 podman[69981]: 2024-09-21 08:02:47.277480731 +0000 UTC m=+3.324995360 container died ee2914c119e4d06203be655014e73ae389d709bb8ab736d77e79a529dd489be0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T08:02:47.910 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:02:47 smithi187 podman[69981]: 2024-09-21 08:02:47.649643496 +0000 UTC m=+3.697158114 container cleanup ee2914c119e4d06203be655014e73ae389d709bb8ab736d77e79a529dd489be0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:02:47.910 INFO:journalctl@ceph.mds.f.smithi187.stdout:Sep 21 08:02:47 smithi187 bash[69981]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-f 2024-09-21T08:02:48.092 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T08:02:48.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:48.126 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T08:02:48.126 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T08:02:48.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.i 2024-09-21T08:02:48.455 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:02:48 smithi187 systemd[1]: Stopping Ceph mds.i for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:48.769 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:02:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i[62990]: 2024-09-21T08:02:48.453+0000 7faa9c57c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:48.769 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:02:48 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i[62990]: 2024-09-21T08:02:48.453+0000 7faa9c57c640 -1 mds.i *** got signal Terminated *** 2024-09-21T08:02:51.519 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:02:51 smithi187 podman[70102]: 2024-09-21 08:02:51.265460468 +0000 UTC m=+2.913815978 container died f850835d2b81a22a0572feaa1426fbdca2d0ecda5680410e518d8ebc6320649d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T08:02:51.914 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:02:51 smithi187 podman[70102]: 2024-09-21 08:02:51.628773369 +0000 UTC m=+3.277128948 container cleanup f850835d2b81a22a0572feaa1426fbdca2d0ecda5680410e518d8ebc6320649d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T08:02:51.914 INFO:journalctl@ceph.mds.i.smithi187.stdout:Sep 21 08:02:51 smithi187 bash[70102]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-i 2024-09-21T08:02:52.035 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T08:02:52.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:52.068 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T08:02:52.068 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T08:02:52.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.l 2024-09-21T08:02:52.269 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 08:02:52 smithi187 systemd[1]: Stopping Ceph mds.l for 679a927c-77ea-11ef-baf5-efdc52797490... 2024-09-21T08:02:52.769 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 08:02:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l[62177]: 2024-09-21T08:02:52.382+0000 7fcca94dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T08:02:52.769 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 08:02:52 smithi187 ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l[62177]: 2024-09-21T08:02:52.382+0000 7fcca94dd640 -1 mds.l *** got signal Terminated *** 2024-09-21T08:02:55.519 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 08:02:55 smithi187 podman[70223]: 2024-09-21 08:02:55.249924961 +0000 UTC m=+2.972681046 container died ff26f2125b94dc78d790ef2fca8c49dea5c4aecccc9d2dfcc2cce4e892ed9060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T08:02:55.876 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 08:02:55 smithi187 podman[70223]: 2024-09-21 08:02:55.607580893 +0000 UTC m=+3.330336980 container cleanup ff26f2125b94dc78d790ef2fca8c49dea5c4aecccc9d2dfcc2cce4e892ed9060 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T08:02:55.876 INFO:journalctl@ceph.mds.l.smithi187.stdout:Sep 21 08:02:55 smithi187 bash[70223]: ceph-679a927c-77ea-11ef-baf5-efdc52797490-mds-l 2024-09-21T08:02:56.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-679a927c-77ea-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T08:02:56.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T08:02:56.063 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T08:02:56.063 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T08:02:56.277 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T08:02:58.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T08:02:59.009 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T08:03:01.433 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T08:03:01.637 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T08:03:04.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:03:04.055 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:03:04.084 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T08:03:04.111 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T08:03:04.113 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi060/crash 2024-09-21T08:03:04.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash -- . 2024-09-21T08:03:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:03:04.154 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:03:04.157 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi123/crash 2024-09-21T08:03:04.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash -- . 2024-09-21T08:03:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:03:04.203 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:03:04.205 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi187/crash 2024-09-21T08:03:04.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash -- . 2024-09-21T08:03:04.250 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/679a927c-77ea-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T08:03:04.250 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now 2024-09-21T08:03:04.251 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T08:03:04.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T08:03:04.289 INFO:tasks.cephadm:Compressing logs... 2024-09-21T08:03:04.289 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:03:04.332 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:03:04.334 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T08:03:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T08:03:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:: No such file or directory 2024-09-21T08:03:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T08:03:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T08:03:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T08:03:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T08:03:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T08:03:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T08:03:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T08:03:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.a.log: 83.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:03:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T08:03:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log 2024-09-21T08:03:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.6.log: /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T08:03:04.365 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:: No such file or directory 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr: 83.3% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T08:03:04.366 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log: 90.6% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T08:03:04.367 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T08:03:04.368 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.l.log: 87.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T08:03:04.368 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T08:03:04.370 INFO:teuthology.orchestra.run.smithi060.stderr: 95.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T08:03:04.373 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.8.log: 90.8% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T08:03:04.373 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T08:03:04.375 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.z.log: 95.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T08:03:04.375 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T08:03:04.376 INFO:teuthology.orchestra.run.smithi060.stderr: 95.1% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T08:03:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T08:03:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T08:03:04.376 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T08:03:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T08:03:04.376 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T08:03:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.x.log: /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.j.log: 87.1% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T08:03:04.378 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T08:03:04.379 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T08:03:04.379 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T08:03:04.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T08:03:04.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T08:03:04.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T08:03:04.383 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T08:03:04.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:03:04.385 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.c.log: 93.3% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T08:03:04.386 INFO:teuthology.orchestra.run.smithi060.stderr: 95.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T08:03:04.386 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:03:04.386 INFO:teuthology.orchestra.run.smithi060.stderr: 95.1%/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.3.log: -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T08:03:04.387 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T08:03:04.391 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/cephadm.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:03:04.399 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:03:04.498 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 93.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T08:03:04.524 INFO:teuthology.orchestra.run.smithi123.stderr: 83.3% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T08:03:04.745 INFO:teuthology.orchestra.run.smithi187.stderr: 93.6% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T08:03:04.780 INFO:teuthology.orchestra.run.smithi060.stderr: 90.8% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T08:03:04.789 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T08:03:04.812 INFO:teuthology.orchestra.run.smithi123.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T08:03:04.816 INFO:teuthology.orchestra.run.smithi123.stderr: 90.5% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T08:03:04.831 INFO:teuthology.orchestra.run.smithi123.stderr: 95.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T08:03:04.947 INFO:teuthology.orchestra.run.smithi187.stderr: 92.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T08:03:05.494 INFO:teuthology.orchestra.run.smithi123.stderr: 87.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T08:03:05.768 INFO:teuthology.orchestra.run.smithi060.stderr: 90.1% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T08:03:05.799 INFO:teuthology.orchestra.run.smithi187.stderr: 95.1% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T08:03:17.407 INFO:teuthology.orchestra.run.smithi060.stderr: 94.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T08:03:18.405 INFO:teuthology.orchestra.run.smithi187.stderr: 94.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T08:03:19.630 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T08:03:20.436 INFO:teuthology.orchestra.run.smithi187.stderr: 94.3% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T08:03:21.440 INFO:teuthology.orchestra.run.smithi060.stderr: 94.1% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T08:03:21.551 INFO:teuthology.orchestra.run.smithi060.stderr: 94.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T08:03:21.553 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-21T08:03:21.553 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m17.207s 2024-09-21T08:03:21.553 INFO:teuthology.orchestra.run.smithi060.stderr:user 1m2.187s 2024-09-21T08:03:21.553 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m2.169s 2024-09-21T08:03:24.916 INFO:teuthology.orchestra.run.smithi187.stderr: 94.3% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T08:03:28.858 INFO:teuthology.orchestra.run.smithi187.stderr: 94.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T08:03:40.889 INFO:teuthology.orchestra.run.smithi187.stderr: 94.0% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T08:03:40.891 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-21T08:03:40.891 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m36.543s 2024-09-21T08:03:40.891 INFO:teuthology.orchestra.run.smithi187.stderr:user 1m50.074s 2024-09-21T08:03:40.891 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m3.835s 2024-09-21T08:04:38.883 INFO:teuthology.orchestra.run.smithi123.stderr: 93.6% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T08:07:42.245 INFO:teuthology.orchestra.run.smithi123.stderr: 94.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T08:07:59.531 INFO:teuthology.orchestra.run.smithi123.stderr: 93.9% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T08:08:17.973 INFO:teuthology.orchestra.run.smithi123.stderr: 95.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T08:09:09.250 INFO:teuthology.orchestra.run.smithi123.stderr: 94.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T08:09:32.654 INFO:teuthology.orchestra.run.smithi123.stderr: 94.2% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T08:12:32.383 INFO:teuthology.orchestra.run.smithi123.stderr: 94.6% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T08:24:53.197 INFO:teuthology.orchestra.run.smithi123.stderr: 93.1% -- replaced with /var/log/ceph/679a927c-77ea-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T08:24:53.243 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-21T08:24:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:real 21m48.897s 2024-09-21T08:24:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:user 13m36.819s 2024-09-21T08:24:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m35.702s 2024-09-21T08:24:53.243 INFO:tasks.cephadm:Archiving logs... 2024-09-21T08:24:53.244 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi060/log 2024-09-21T08:24:53.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:25:01.343 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi123/log 2024-09-21T08:25:01.344 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:27:03.362 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi187/log 2024-09-21T08:27:03.366 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T08:27:16.792 INFO:tasks.cephadm:Removing cluster... 2024-09-21T08:27:16.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --force 2024-09-21T08:27:17.005 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T08:27:17.348 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --force 2024-09-21T08:27:18.127 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T08:27:18.962 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 679a927c-77ea-11ef-baf5-efdc52797490 --force 2024-09-21T08:27:19.165 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: 679a927c-77ea-11ef-baf5-efdc52797490 2024-09-21T08:27:19.551 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T08:27:19.552 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:27:19.572 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:27:19.589 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T08:27:19.605 INFO:tasks.cephadm:Teardown complete 2024-09-21T08:27:19.606 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T08:27:19.618 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T08:27:19.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:27:19.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:27:19.631 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T08:27:19.751 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T08:27:19.761 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T08:27:19.761 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:27:19.764 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:27:19.766 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T08:27:19.778 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:27:19.779 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:27:19.781 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2024-09-21T08:27:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:27:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-21T08:27:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +13us[ +15us] +/- 44ms 2024-09-21T08:27:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -35us[ -35us] +/- 58ms 2024-09-21T08:27:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +126us[ +128us] +/- 74ms 2024-09-21T08:27:19.784 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:27:19.786 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:27:19.786 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-09-21T08:27:19.786 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -11us[ -13us] +/- 44ms 2024-09-21T08:27:19.786 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -46us[ -46us] +/- 58ms 2024-09-21T08:27:19.786 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +72us[ +72us] +/- 74ms 2024-09-21T08:27:19.786 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:27:19.851 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T08:27:19.852 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-21T08:27:19.852 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +392ns[+6959ns] +/- 44ms 2024-09-21T08:27:19.852 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -57us[ -51us] +/- 58ms 2024-09-21T08:27:19.852 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +110us[ +110us] +/- 74ms 2024-09-21T08:27:19.852 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T08:27:19.870 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T08:27:19.880 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T08:27:19.880 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T08:27:19.894 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:27:19.978 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:27:20.121 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T08:27:20.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:27:20.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:27:20.220 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:27:20.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:27:20.249 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T08:27:20.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:27:20.277 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T08:27:20.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T08:27:20.301 INFO:teuthology.task.internal:Duration was 4176.135844 seconds 2024-09-21T08:27:20.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T08:27:20.315 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T08:27:20.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:27:20.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:27:20.320 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T08:27:20.358 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:27:20.359 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:27:20.371 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T08:27:20.713 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T08:27:20.713 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T08:27:20.714 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:27:20.736 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-09-21T08:27:20.736 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:27:20.790 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-09-21T08:27:20.790 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T08:27:20.815 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T08:27:20.815 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:27:20.818 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:27:20.820 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T08:27:20.881 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T08:27:20.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:27:20.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:27:20.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T08:27:21.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T08:27:21.407 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T08:27:21.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:27:21.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:27:21.473 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T08:27:21.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T08:27:21.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:27:21.515 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:27:21.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:27:21.536 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-21T08:27:21.547 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-09-21T08:27:21.564 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-09-21T08:27:21.608 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:27:21.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:27:21.623 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:27:21.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:27:21.638 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T08:27:21.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:27:21.663 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T08:27:21.676 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T08:27:21.677 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi060 2024-09-21T08:27:21.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:27:21.722 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi123 2024-09-21T08:27:21.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:27:21.762 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913594/remote/smithi187 2024-09-21T08:27:21.762 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T08:27:21.798 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T08:27:21.798 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:27:21.801 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:27:21.803 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T08:27:21.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T08:27:21.859 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T08:27:21.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T08:27:21.874 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T08:27:21.874 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:27:21.877 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:27:21.879 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T08:27:21.890 INFO:teuthology.orchestra.run.smithi060.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:27 /home/ubuntu/cephtest 2024-09-21T08:27:21.892 INFO:teuthology.orchestra.run.smithi123.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:27 /home/ubuntu/cephtest 2024-09-21T08:27:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 08:27 /home/ubuntu/cephtest 2024-09-21T08:27:21.903 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T08:27:21.915 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T08:27:21.949 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} duration: 4176.135843515396 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T08:27:21.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T08:27:22.033 INFO:teuthology.run:pass